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PREFACE 


This  Final  Technical  Report  on  the  Nonoperating  Failure  Rates  for 
Avionics  Study  was  prepared  by  the  Design  Effectiveness  Operations  organi¬ 
zation  of  the  Hughes  Aircraft  Company,  Culver  City,  California,  under 
Contract  F30602-77-C-0187,  for  Rome  Air  Development  Center,  Griffiss 
Air  Force  Base,  New  York.  The  major  objectives  of  the  study  were  to 
investigate  the  existence  and  magnitude  of  nonoperating  failure  rates  for 
avionic  equipments . 

The  contract  was  issued  on  19  September  1977  by  Rome  Air  Develop¬ 
ment  Center,  Griffiss  Air  Force  Base,  New  York.  Mr.  Eugene  Fiorentino 
(RBRT)  was  the  RADC  Project  Engineer.  The  period  of  performance  was 
from  1  September  1977  through  1  March  1979. 

Technical  consultation  and  assistance  in  the  acquisition  of  the 
required  MDC  system  maintenance  data  were  provided  by  Mr.  Chuck  Gross 
(HQ  AFLC/LOEP),  and  Mr.  William  Harrison  (HQ  AFLC/ACVM),  whose 
efforts  contributed  significantly  to  the  successful  completion  of  this  study. 
Mr.  George  A.  Kern  was  the  Hughes  study  program  manager.  Mr.  Kern 
and  Messrs.  Irving  Quart,  Steve  S.  Tung,  and  Kam  L.  Wong  were  the 
principal  investigators.  Appreciation  is  also  extended  to  Dr.  J.  Kallis  for 
his  assistance  in  helping  organize  and  summarize  the  results  for  publication 
in  this  final  report.  Other  Hughes  study  team  members  were:  R.  Gibson, 
E.  Gulian,  G.  Heckman,  H.  Jaffe,  V.  Jones,  R.  Knopf,  R.  Lorenz, 

L.  McWilliams,  Dr.  S.  Moite,  J.  Rose,  and  W.  Zeller. 
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EVALUATION 


The  objective  of  this  study  was  to  assess  the  relative  significance  and 
magnitude  of  nonoperating  environmental  effects  on  avionic  equipment  reliability 
in  relation  to  predicted  and  field  observed  failure  rates. 

The  objectives  have  been  satisfactorily  achieved.  Results  of  the  investigation 
indicate  that  nonoperating  effects  contribute  approximately  10-30%  to  total  ob¬ 
served  failures  and  that  such  effects  can  significantly  impact  operationally  ready 
rates.  The  study  has  highlighted  the  need  for  including  the  effects  of  the 
nonoperating  environment  in  reliability  modeling  techniques.  In  addition,  the  study 
has  shown  that  field  MTBF  assessments  which  fail  to  properly  account  for  time  of 
failure  occurrence,  can  lead  to  seriously  misleading  estimates  of  mission  relia¬ 
bility. 

Study  results  will  be  used  in  the  further  development  of  avionics  reliability 
prediction  techniques  which  more  accurately  reflect  field  operating  and  nonopera¬ 
ting  conditions.  The  study  has  also  contributed  valuable  findings  pertaining  to  the 
use  of  field  performance  data  in  future  reliability  studies. 


EUGENE  FIORENTINO 
PROJECT  ENGINEER 


MANAGEMENT  SUMMARY 


The  lack  of  correlation  between  predicted,  demonstrated,  and  field 
reliability  of  avionic  equipment  has  been  a  matter  of  concern  to  the  Air 
Force  for  some  time.  Recent  studies  indicate  predicted  MTBF  to  be 
between  5  and  50  times  greater  than  field  MTBF.  When  comparing  the 
demonstrated  to  field  MTBFs,  the  corresponding  ratios  are  between  3  to 
1  and  20  to  1.  Furthermore,  predicted  reliability  is  consistently  higher 
than  actual  field  operational  reliability. 

A  previous  study  performed  by  Hughes  Aircraft  Company  for  RADC 
entitled  Operational  Influences  on  Reliability  (OIR)  identified  the  causes  of 
this  lack  of  correlation.  The  need  for  a  better  understanding  of  the  charac¬ 
teristics  and  magnitude  of  avionic  equipment  failures  accrued  during  non¬ 
operating  time  was  identified  during  the  OIR  study.  The  reason  for  interest 
in  this  parameter  was  that  the  method  used  by  AFIX  for  assessing  equipment 
MTBF  is  based  on  the  count  of  all  failures  (regardless  of  when  discovered) 
divided  into  equipment  operating  time.  Since  some  fraction  of  these  failures 
may  have  occurred  during  nonoperating  time,  the  resultant  value  of  assessed 
MTBF  tends  to  be  lower  than  the  value  of  operating  MTBF  that  would  be 
obtained  by  including  only  those  failures  that  occurred  during  the  operating 
time  of  interest  for  the  assessment.  Although  the  nonoperating  failure  rates 
may  be  only  a  small  fraction  of  the  operating  failure  rates,  e.g. ,  l/20th, 
the  relative  amount  of  time  accrued  in  the  nonoperating  state  is  about 
20  times  greater  than  the  operating  time.  Therefore,  the  assessed  MTBF 
in  the  field  could  easily  be  doubled  if  only  operating  failures  and  operating 
time  were  included  in  the  assessment  of  field  MTBF.  One  of  the  key  recom¬ 
mendations  of  the  OIR  study  was  to  establish  nonoperating  failure  rates  for 


various  types  of  avionic  equipments.  This  recommendation  led  to  the  present 
study. 

The  primary  objectives  of  the  Nonoperating  Failure  Rates  for 'Avionics 
(NOFRA)  study  were 

1.  Investigate  the  existence  and  magnitude  of  nonoperating  failure 
rates  for  avionics. 

2.  Establish  the  significant  influencing  factors  by  which  nonoperat¬ 
ing  failure  rates  are  affected. 

3.  Recommend  methods  for  incorporating  study  findings  into 
MIL-HDBK-2  17B. 

More  specific  objectives  of  the  study  included:  (1)  Predict  operating 
MTBFs  for  a  representative  mix  of  avionic  equipments  using  the  methods  of 
MIL-HDBK-2 17B,  and  compare  the  predictions  with  the  results  of  field 
assessed  MTBFs  based  on  present  measures  of  field  reliability  (using  total 
failures)  and/or  field  reliability  considering  only  operating  failures. 

(2)  Determine  the  extent  to  which  nonoperating  failures  affect  the  measured 
MTBF,  and  (3)  Ascertain  how  parts  mix  affects  nonoperating  failure  rates. 

The  major  elements  of  the  analytical  tasks  are  shown  in  Figure  MS-1 
in  the  form  of  a  study  flow  diagram.  The  data  flow  began  with  the  acquisition 
of  the  AFLC  field  data  pertaining  to  each  of  the  equipments  and  weapon  sys¬ 
tems  included  in  the  study.  These  data  and  data  retrieved  from  Hughes  data 
files  on  the  equipment  and  weapon  platform  characteristics  were  then  organ¬ 
ized,  validated,  and  reduced  to  develop  the  data  baseline.  An  added  input  to 
this  data  baseline  was  the  predicted  MTBF  values  resulting  from  the  new 
baseline  predictions  for  the  six  equipment  types  included  in  the  study  based 
on  MIL-HDBK- 217B.  A  literature  search  provided  the  latest  information 
on  models  and  factors  affecting  failure  rates,  especially  the  environments 
to  which  avionic  equipments  are  exposed  and  their  effects,  and  the  effects 
of  equipment  age  and  mission  duration  on  failure  rates.  The  following 
approaches  were  used  to  quantify  the  nonoperating  failure  rate  characteristics 
of  the  equipments  included  in  the  study:  (1)  Direct  quantification  based  on 
maintenance  data  analysis  (measured  field  failure  rates  based  on  the  when 
discovered  codes),  and  (2)  Indirect  quantification  using  regression  analysis 
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Figure  MS- 1 .  Flow  diagram  for  NOF  RA  study. 

methods  in  which  mission  duration,  duty  cycle,  and  parts  mix  were  used  as  the 
variables  of  interest.  Data  vectors  in  terms  of  matrices  were  developed 
based  on  the  available  data  and  the  requirements  from  the  models.  Statistical 
analyses  were  then  performed  leading  to  the  development  of  non-operating 
failure  rate  indicators.  All  the  data  and  the  findings  were  then  compiled  into 
this  final  report. 

The  data  base  used  for  this  study  was  a  compromise  between  the  study 
requirements  and  the  limitations  of  available  resources  (person-hours)  for 
performing  the  new  predictions,  and  compiling  and  reducing  the  field  opera¬ 
tional  data.  The  final  selection  of  avionic  equipment  applications  (combina¬ 
tions  of  an  equipment  and  a  weapon  platform)  is  listed  in  Table  MS-1.  They 


MS- 3 


TABLE  MS-1.  EQUIPMENT/ WEAPON  PLATFORM  MATRIX 


Weapon  Platform  Types 

Fighters 

Interceptors 

Bombers, 

Transports 
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CO 

Q 

OJ 

IT 

52G 

X 

fM 

If) 

KC-1  35 

Equipment 

< 

< 

1 

k 

Ui 

H 

H 

H 

cc 

0 

EQ 

u 

o 

1.  ARN-118  TACAN 

X 

X 

1 

G 

X 

X 

X 

X 

X 

X 

X 

X 

X 

2.  ARC-164  UHF  Radio 

X 

X 

X 

E 

X 

X 

X 

X 

X 

X 

X 

X 

3.  AAQ-6  FLIR 

X 

4.  C-1108  Video  Monitor 

5.  AYK-12  Computer 

6.  ARN-  131  OMEGA  Nav. 

X 

1 

1 

X 

X 

X 

_ 

were  drawn  from  five  USAF  operating  commands  (ADC,  A  TC  ,  MAC,  SAC 
and  TAC)  and  comprise  a  one-year  data  base  consisting  of  six  A N-des ignated 
equipment  types  which  collectively  represent  3,817,000  equipment  flight  hours 
(CY  1  978),  9,255  equipments,  17,500  maintenance  action  record  sets,  and 
1  0,  600  failures. 

The  major  results  of  the  study  are  as  follows.  The  calculated  MTBF 
(using  only  failures  detected  during  operating  periods)  was  an  average  23  per¬ 
cent  higher  for  the  six  equipment  types  investigated  than  the  AF  reported 
MTBF  (which  included  all  failures).  The  MTBF  difference  was  more  than 
50  percent  for  the  Cl  108  video  monitor.  The  percentage  MTBF  improvement 
factors  derived  for  each  of  the  equipment  types  studied  are  presented  in  Fig¬ 
ure  MS-2.  Comparable  values  were  obtained  using  two  other  indirect  methods 
for  the  ARN-  1 1  8  TACAN  and  the  ARC  -1  64  UHF  radio,  as  shown  in  Table  MS-2. 
Comparing  the  operating  to  nonoperating  failure  rate  ratios  indicates  that  this 
characteristic  varies  over  a  wide  range  as  shown  in  Figure  MS-3.  The  aver¬ 
age  ratios  of  measured  operating  to  nonoperating  failure  rates  for  the  six  equip 
ment  types  investigated  ranged  between  41  and  188  and  had  an  average  value 
of  113.  This  method,  however,  possibly  overestimates  the  ratio,  because 
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Figure  MS-2.  MTBF  improvement  factor. 


Figure  MS-3.  Ratio  of  operating  to 
nonoperating  failures. 


TABLE  MS-2.  MTBF  IMPROVEMENT  OVER  AIR  FORCE  REPORTED  MTBF 


Analysis  Method 

Based  on  Equipment 

%  MTBF  Improvement 

WD  (When  Discovered) 
(By  deleting  failures 
discovered  during  non¬ 
operating  period) 

All  Six  Equipments 

22.7 

ARN-118  TACAN 

8.6 

ARC- 164  UHF  Radio 

12.3 

DC  (Duty  Cycle) 
Regression  Analysis 

ARN-118  TACAN 

29.5 

ARC-164  UHF  Radio 

2.8 

MD  (Mission  Duration) 
Regression  Analysis 

ARN-118  TACAN 

11.6 

ARC -164  UHF  Radio 

-3.4 

some  failures  that  occur  during  nonoperating  time  are  not  detectable  while  the 
aircraft  is  on  the  ground,  hence,  they  are  counted  as  operating  failures  even 
though  they  may  have  occurred  during  nonoperating  time.  The  ratios  esti¬ 
mated  for  the  ARN-118  TACAN  and  the  ARC -164  UHF  radio  by  means  of  the 
duty  cycle  analysis  method  were  found  to  be  41  and  73  respectively,  compared 
to  188  and  132  with  the  When  Discovered  (WD)  method. 
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The  following  conclusions  and  recommendations  have  been  derived 
from  this  study: 

Conclusions: 

1.  Nonoperating  failures  have  a  measurable  effect  on  assessed 
operational  MTBF  of  avionic  equipment.  For  the  equipments 
studied  the  average  non-operating  failure  contribution  is 
approximately  10  to  30  percent  of  the  total  number  of  failures 
for  typical  utilization  rates  of  20  to  60  hours  per  month. 
Therefore,  it  is  imperative  that  only  operating  failures  be 
counted  in  mission-oriented  failure  rate  determination. 

2.  Field  nonoperating  failure  rates  cannot  be  predicted  to  a  reason¬ 
able  degree  of  accuracy  using  any  of  the  established  prediction 
methods.  The  data  for  the  six  equipment  types  investigated  pre¬ 
clude  the  establishment  of  consistent  relationships  between  pre¬ 
dicted  and  measured  nonoperating  failure  rates. 

3.  The  analysis  results  did  not  verify  the  current  belief  that  micro¬ 
electronic  parts  have  a  lower  ratio  of  operating  to  nonoperating 
failure  rates  than  other  types  of  parts.  This  finding,  however, 
may  be  due  to  a  number  of  other  variables  affecting  the  data  on 
which  this  study  was  based. 

4.  Environmental  severity  factors  (ESFs)  appear  to  be  both  equip¬ 
ment  and  platform  dependent.  This  indicates  that  the  develop¬ 
ment  of  only  average  ESF  or  similar  factors,  such  as  for 
all  types  of  avionic  equipment  may  give  very  erroneous  results 
with  respect  to  a  specific  equipment  type. 

Recommendations: 

1.  Any  study  of  the  effects  of  environmental  stress  on  avionic 
equipment  failure  rates  should  also  consider  the  influence  of 
other  factors  such  as  equipment  function  and  maintenance  policy 
on  the  equipment's  field  failure  rate. 

2.  Age  has  a  significant  influence  on  the  magnitude  of  the  failure 
rate  at  any  point  of  time.  Therefore,  effects  of  age  must  be 
normalized  in  any  failure  rate  studies  that  involve  equipments 
having  a  variety  of  ages. 

3.  To  permit  more  meaningful  inferences  to  be  drawn  from  the  data 
base  used  for  studies  cf  this  type,  future  studies  should  be  planned 
to  include  equipments  with  the  following  characteristics: 

a.  Relatively  uniform  and  constant  equipment/platform  combi¬ 
nation  population  throughout  the  study  period  so  that  vari¬ 
ation  due  to  equipment  age  and  flaw  removal  rates  can  be 
minimized. 
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b.  Each  equipment  type  should  be  on  several  different  aircraft 
types  (more  than  four  if  possible)  for  each  category  (bomber, 
fighter,  etc.)  of  interest  in  which  the  equipment  is  used. 

c.  The  equipment  types  selected  should  have  a  uniformly  distri¬ 
buted  range  of  complexity  to  prevent  biasing  of  analysis 
results  by  equipment  with  extremely  high  or  low  complexities. 

4.  Differences  in  the  maintenance  action  documentation  procedures 
as  implemented  by  the  various  operating  commands  and/or  bases 
should  be  further  investigated  so  that  the  influence  of  the  documentation 
procedural  differences  can  be  accounted  for  in  the  performance 
assessment  process  by  those  using  maintenance  data  collection 
system  (MDCS)  data  for  studies  similar  to  the  one  reported  on 
herein. 


1.0  INTRODUCTION 


1.  1  BACKGROUND 

1.1.1  Lack  of  Correlation  Between  Three  Measures  of  Avionic  Equipment 

Reliability 

The  apparent  lack  of  correlation  between  predicted,  demonstrated, 
and  field  reliability  of  avionic  equipment  has  been  a  matter  of  concern  to  the 
Air  Force  for  some  time.  The  results  of  a  number  of  recent  studies 
(References  1  through  5)  indicate  predicted  MTBF  to  be  between  five  and 
50  times  greater  than  field  MTBF.  When  comparing  the  demonstrated  to 
field  MTBFs,  the  corresponding  ratios  are  between  3  to  1  and  20  to  1. 

1.1.2  Contributions  of  Hughes  OIR  Study 

1 .  1 .  2.  1  Causes  of  the  Lack  of  Correlation 

A  previous  study  performed  by  Hughes  Aircraft  Company  for  RADC 
entitled  Operational  Influences  on  Reliability  (OIR)  identified  the  causes  of 
this  lack  of  correlation  and  established  quantitative  relationships  between  the 
three  values  (References  6  through  9).  The  results  indicated  that  the  differ¬ 
ences  were  due  to  a  combination  of  definitional  factors  (i.e.  ,  what  is  a  fail¬ 
ure,  what  is  the  time  base?)  and  operational  factors.  Significant  differences 
in  operational  reliability  were  observed  between  equipment  installed  on 
fighter/interceptor  aircraft  and  on  heavy  bomber/transport  aircraft,  as  well 
as  between  sets  of  the  same  equipment  installed  on  different  aircraft  of  the 
same  type.  Among  the  reasons  for  the  differences,  the  definitional  factors 
were  found  to  be  the  largest  single  influencing  factor.  Some  factors  affecting 
predicted  and  measured  failure  rates  are  shown  in  Figure  1-1. 
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Figure  1-1.  Factors  affecting  predicted  and  measured  failure  rates  for  avionics  equipment. 
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Another  area  to  be  considered  is  that  reliability  predictions  seem  to 
be  consistently  higher  than  actual  field  operational  reliability.  Experience 
on  the  OIR  study  confirmed  this,  but  what  is  generally  not  recognized  by 
those  who  look  critically  at  predicted  values  of  reliability  is  that  the  predic¬ 
tions  can  indicate  only  what  the  inherent  reliability  of  the  mature  hardware 
can  be  under  a  certain  set  of  design  and  environmental  conditions.  Since  the 
predictors  have  no  control  over  a  number  of  factors  that  can  have  a  very  sig¬ 
nificant  impact  on  the  actual  value  of  the  achieved  reliability  (such  as  the 
skill  levels,  logistic  support  resources,  facilities,  working  and  operating 
conditions  and  the  degree  to  which  design  and  software  changes  required  for 
maturation  are  implemented),  how  could  they  be  expected  to  do  anything  but 
predict  an  inherent  reliability  characteristic?  Numerous  questions  were 
raised  during  the  OIR  study  regarding  the  impact  of  nonoperating  failures  on 
the  acquisition,  development,  user  and  logistics  community.  In  response  to 
these  questions,  the  present  study  took  on  a  considerably  broader  view  than 
the  originally  stated  objective. 

1.1.2.  2  Importance  of  Nonoperating  Failures 

The  need  for  a  better  understanding  of  the  characteristics  and  mag¬ 
nitude  of  avionic  equipment  failures  accrued  during  nonoperating  time  was 
identified  during  the  OIR  study.  The  reason  for  interest  in  this  parameter 
was  that  the  method  used  by  AFLC  for  assessing  equipment  MTBF  is  based 
on  the  count  of  all  failures  (regardless  of  when  discovered)  divided  into 
equipment  operating  time.  Some  fraction  of  these  failures  may  have  occurred 
during  nonoperating  time.  The  resultant  value  of  assessed  MTBF,  therefore, 
tends  to  be  lower  than  the  value  of  operating  MTBF  that  would  be  obtained 
if  only  those  failures  that  occurred  during  the  operating  time  of  interest  are 
included. 

Although  the  nonoperating  failure  rates  may  be  only  a  small  fraction 
of  the  operating  failure  rates,  e.g.,  I/20th,  the  relative  amount  of  time 
accrued  in  the  nonoperating  state  is  about  20  times  greater  than  the  operating 
time.  Therefore,  the  assessed  MTBF  in  the  field  could  easily  be  doubled 
if  only  operating  failures  and  operating  time  were  included  in  the  assessment 
of  field  MTBF. 
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1 .  1 .  2.  3  Quantitative  Effect  of  Nonoperating  Failures 

A  nomograph  was  developed  during  the  OIR  study  (Reference  6)  which 
will  help  visualize  the  relationship  between  the  operating /nonoperating  failure 
rate  ratio  of  an  equipment.  The  nomograph  also  helps  visualize  how  the 
distribution  of  the  relative  failure  fractions  (expressed  as  a  percentage  of 
total  failures)  is  influenced  by  the  equipment's  utilization  rate. 

The  following  rationale  was  used  to  derive  the  equation  for  calculation 
of  the  equipment  operating  and  nonoperating  failure  contributions  to  the  total 
failures  observed  during  a  given  period  of  time.  It  is  assumed  that  during 
the  period  of  nonoperation,  the  equipment's  primary  environment  is  that 
seen  while  it  is  installed  on  the  weapon  system  (aircraft)  or  undergoing 
maintenance. 

Consider  the  following  expressions: 

^OP 

- -  x 

*NOP 


To?  +  tnqP  =  k°urs  per  month 


365 


year 

1 2  montlTs 
year 


730 


\ 


hrs 
month J 


Top  =  K(UR) 

FOP  =  *qPTCP 

FNOP  =  *NOpTNOP 
FTOT  =  FOP  +  F  NOP 


where 

Xqp  =  Equipment  operating  failure  rate  (failures /hour ) 
^NOP  =  Equipment  nonoperating  failure  rate  (failures /hour ) 


1-4 


x  =  Ratio  of  equipment  operating  to  nonoperating  failure  rate 


TqP  =  Equipment  operating  time  per  month  (hours) 

Tnop  =  Equipment  nonoperating  time  per  month  (hours) 

K  =  Equipment  operating  time/flight  hours  ratio 
UR  =  Aircraft  utilization  rate  (in  flight  hours/month/aircraft) 

FOP  =  Number  of  equipment  operating  failures  per  month 
FNOP  =  Number  of  equipment  nonoperating  failures  per  month 
FTOT  =  Total  number  of  equipment  failures  per  month 

Then  to  derive  the  relative  contribution  of  operating  failures  to  total 
failures  expressed  as  a  percentage, 
let 

g,  100  FOP 
/0OP*  FTOT 

Substituting  these  equations  into  the  formula  for  the  percentage 
operating  failures  (‘'“Qp)  yields  the  following  relationship  between  %Qp* 
the  ratio  x  of  operating  to  nonoperating  failure  rates,  the  ratio  K  of 
the  equipment  operating  time  to  flight  hours,  and  the  equipment  utilization 
rate  UR: 


% 


100  x 


OP 


x  -  1  + 


730 

K(UR) 


(1-1) 


The  relative  contribution  of  operating  and  nonoperating  equipment 
failures  was  assessed  using  the  method  described  for  failure  rate  ratios 
x  =  10,  20,  40,  80,  and  160:1.  The  range  of  values  of  the  product  of  K 
and  the  equipment  utilization  rate  used  for  the  analysis  was  from  5  to  100 
operating  hours  per  month  per  equipment.  These  ranges  encompass  the 
range  of  values  characteristic  of  the  equipment  included  in  the  study. 

This  resulted  in  the  development  of  the  nomograph  given  in  Figure  1-2. 
The  expected  distribution  of  operating  and  nonoperating  failures  for  a 
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Figure  1-2.  Equipment  operating  and  nonoperating 
failure  contribution. 


given  item  of  equipment  can  be  estimated  from  Figure  1-2.  The  data 
required  to  use  the  nomograph  are  the  equipment's  utilization  rate  (expressed 
in  equipment  operating  hours  per  month  per  equipment)  and  the  ratio  of  the 
equipment's  operating  to  nonoperating  failure  rates.  Alternatively,  the 
nomograph  can  also  be  used  to  derive  the  ratio  of  operating  to  nonoperating 
failure  rates  if  the  equipment’s  utilization  rate  and  either  the  percentage  of 
operating  or  nonoperating  failures  is  known. 


f. 
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As  technology  advances  toward  more  widespread  use  of  solid  state 
devices  and  microcircuits,  the  differences  between  operating  and  nonoperat¬ 
ing  stresses  and  temperature  levels  will  become  even  smaller.  Therefore, 
the  failure  rates  pertaining  to  the  nonoperating  period  may  no  longer  be 
negligible  which  would  increase  the  percentage  of  nonoperating  failures 
even  more  as  shown  in  Figure  1-2. 

According  to  the  commonly  used  method  of  MTBF  assessment,  the 
denominator  of  the  equation 

MTBF  =  Qg.?La^.ng  Time 
F  allures 


includes  all  failures  observed,  without  regard  to  the  fact  that  some  of  the 
failures  occurred  during  nonoperating  time,  the  assessed  MTBF  value 
obtained  tends  to  underestimate  the  true  value  of  operating  MTBF. 

1.  1.  2.4  Effect  of  Nonoperating  Failures  on  the  Weapon  System  End 
User  ~~  "  “ 

From  a  standpoint  of  the  weapon  system  end  user  (TAC,  SAC,  MAC, 
ADC  or  ATC),  two  parameters  of  prime  interest  are  mission  reliability  and 
operational  readiness.  The  AFLC  derived  value  of  mission  reliability  is 
obviously  understated  by  the  current  method  of  assessment,  and  the  impact 
of  nonoperational  failures  on  operational  readiness  is  unknown,  since  the 
AFLC  assessment  methods  do  not  include  nonoperating  failure  rate  in  MTBF 
asses  sment  s . 

Looking  at  the  problem  of  avionic  equipment  failures  from  the  logis- 
ti  ipport  (AFLC)  viewpoint,  the  impact  of  failures  on  logistic  support 
jurces  (in  terms  of  demand  on  supply)  is  of  prime  interest.  To  make 
more  meaningful  and  valid  projections  of  logistic  support  requirements,  a 
means  wf  estimating  support  requirements  for  both  the  installed  avionic 
equipment  inventory  and  the  supply  inventory  is  desired.  The  term  supply 
inventory  includes  the  number  of  spare  equipments  in  base  and  depot  level 
supply.  The  maintenance  data  reported  under  the  AFM  66-1  Maintenance 
Data  Collection  system  (Reference  10)  are  not  summarized  to  permit 


reporting  demands  on  logistic  resources  generated  during  weapon  system 
operating  or  nonoperating  time  and  the  data  do  not  identify  failed  items 
found  on  removal  from  supply.  Therefore,  AFLC  must  rely  on  empirically 
derived  methods  for  developing  provisioning  forecasts  based  on  past  his¬ 
torical  records.  With  recent  advances  in  electronics  technology  and  the 
increasing  complexity  of  avionic  equipments,  the  methods  currently  used  by 
AFLC  for  provisioning  estimates  could  result  in  either  overprocurement 
or  under  procurement,  depending  on  the  item  of  interest. 

1 .  1 .  2.  5  OIR  Study  Recommendation 

One  of  the  key  recommendations  of  the  OIR  study  was  to  establish 
nonoperating  failure  rates  for  various  types  of  avionic  equipments.  This 
recommendation  led  to  the  present  study. 

1.  2  STATEMENT  OF  STUDY  OBJECTIVES 

The  primary  objectives  of  the  Nonoperating  Failure  Rates  for  Avionics 
(NOFRA)  study  were: 

1.  Investigate  the  existence  and  magnitude  of  nonoperating 
failure  rates  for  avionics 

2.  Establish  the  significant  influencing  factors  by  which 
nonoperating  failure  rates  are  affected 

3.  Recommend  methods  for  incorporating  study  findings  into 
MIL-HDBK-2  17B. 

More  specific  objectives  of  the  study  included:  (1)  Perform  predictions 
for  operating  MTBFs  of  a  representative  mix  of  avionic  equipments  using  the 
methods  of  MIL-HDBK- 2 17 B  and  compare  the  predictions  with  the  results 
of  field  assessed  MTBFs  based  on  present  measures  of  field  reliability 
(using  total  failures)  and/or  field  reliability  considering  only  operating 
failures,  (2)  Determine  the  extent  to  which  nonoperating  failures  affect  the 
measured  MTBF,  and  (3)  Ascertain  how  parts  mix  affects  nonoperating 
failure  rates. 
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1.  3  THE  DEFINITIONAL  PROBLEM  OF  NONOPERATING  FAILURE  RATES 


1.3.1  Statement  of  the  Problem 

Any  consideration  of  nonoperating  failure  rates  must  employ  very 
carefully  defined  terms.  A  literal  interpretation  would  be  as  follows:  ''The 
failure  rate  while  the  equipment  is  not  operating."  This  leads  to  some  diffi¬ 
culty  since  generally  a  failure  cannot  be  observed  without  operating  the 
equipment.  A  failure  observed  at  the  time  of  turn-on  raises  the  question  of 
whether  it  was  due  to  turn-on  or  whether  it  had  occurred  at  some  unknown 
time  before  turn-on. 

Assuming  that  these  difficulties  can  be  resolved,  this  interpretation 
must  not  make  the  inherent  assumption  that  stresses  during  "operating" 
times  contribute  only  to  operating  failure  rates  while  stresses  during  "non¬ 
operating"  times  contribute  only  to  nonoperating  failure  rates.  This,  of 
course,  is  never  the  case.  Any  failure  is  the  result  of  the  cumulative  expo¬ 
sure  to  stresses  applied  over  the  total  previous  history  of  the  unit.  Further¬ 
more,  fatigue  studies  show  wide  variations  in  the  cumulative  stresses 
required  to  cause  a  failure  and  show  that  the  cumulative  damage  is  a  function 
of  the  order  in  which  those  stresses  are  applied.  However,  the  concept  of 
operating  and  nonoperating  failure  rates  is  a  very  useful  artifice  in  commonly 
performed  reliability  analyses.  If  such  an  artifice  yields  a  useful  analytical 
result,  it  is  an  acceptable  analytical  tool. 

If  the  equipment  is  found  to  have  a  discrepancy  at  time  zero,  the 
failure  impacts  weapon  system  mission  capable  rate,  and  it  is  immaterial 
whether  the  equipment  failed  at  the  instant  of  turn-on  or  at  any  time  before 
turn-on.  Regardless  of  when  the  failure  actually  occurred,  the  detection 
of  a  discrepancy  at  time  zero  has  impacted  on  the  mission  capable  rate. 

Had  the  failure  not  been  detected  until  after  the  start  of  the  mission,  it 
would  have  impacted  mission  reliability  and  not  mission  capability.  Hence, 
its  classification  as  an  operating  failure  would  be  appropriate. 


1.3.2  Definitions  Used  in  NOFRA  Study 


To  clarify  the  terms  "operating"  and  "nonoperating"  time  or  failure, 
the  following  definitions  are  used  in  the  NOFRA  study: 

1.  Operating  time  is  the  time  during  which  the  avionic  equipment  is 
energized  and  is  performing  its  function,  either  on  or  off  the  air¬ 
craft,  either  in  support  of  the  mission  or  during  the  performance 
of  maintenance  activities. 

2.  Nonoperating  time  is  the  time  during  which  the  equipment  is  in 
its  normal  installation  configuration,  fully  connected  but  not 
energized  or  otherwise  operated.  Also  included  in  nonoperating 
time  is  the  time  an  equipment  accrues  in  either  a  base  or  stor¬ 
age  depot  level  supply  status,  not  connected  to  a  system,  and 
during  which  time  it  experiences  a  somewhat  more  benign  envi¬ 
ronment  than  when  installed  (but  nonoperating)  on  the  weapon 
platform  (includes  transportation  and  handling). 

During  the  study,  it  became  apparent  that  the  meaning  of  nonoperating 
failure  rate  depends  on  how  it  is  defined.  This  problem  stems  from  many 
factors  such  as  failure  detectability,  test  thoroughness,  maintenance  policy 
implementation,  data  recording  procedures,  and  the  necessity  for  turning  on 
the  equipment  to  detect  a  failure.  It  became  clear  that  the  calculation  of 
nonoperating  failure  rates  (or  whatever  one  might  call  it)  is  entirely  depend- 
end  on  the  ultimate  use  of  the  rates.  For  mission  reliability  purposes, 
nonoperating  failure  rate  could  encompass  all  failures  that  occurred  outside 
of  the  mission  time.  For  logistics  and  maintenance  optimization,  it  is 
necessary  to  know  the  equipment's  failure  rate  when  it  is  not  operated  or  in 
storage.  Therefore,  in  this  study,  nonoperating  failure  rates  were  derived 
using  several  methods.  The  values  and  ratios  of  both  operating  and  non¬ 
operating  failure  rates  are  presented  in  the  section  entitled  Summary  of 
Analysis  Results. 

All  terms  used  in  this  report  are  as  defined  in  MIL-STD-721A  (Ref¬ 
erence  12)  unless  a  more  specific  definition  is  given  in  Section  7.0  titled 
"Definitions"  of  this  report.  Whenever  reference  is  made  to  flying  hours, 
sorties,  or  mission  duration,  these  terms  are  as  defined  in  AFM  65-110, 
Aerospace  Vehicle  Status  Reporting  (Reference  13). 
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2.0  APPROACH 


The  major  elements  of  the  analytical  tasks  are  illustrated  in 
Figure  2-1  in  the  form  of  a  study  flow  diagram.  The  data  flow  begins  with 
the  acquisition  of  the  AFLC  field  data  pertaining  to  each  of  the  equipments 
and  weapon  systems  included  in  the  study.  These  data  and  data  retrieved 
from  Hughes'  data  files  on  the  equipment  and  weapon  platform  characteris¬ 
tics  were  then  organized,  validated,  and  reduced  to  develop  the  data  base¬ 
line.  An  added  input  to  this  data  baseline  was  the  predicted  MTBF  value 
resulting  from  the  new  baseline  prediction  based  on  M1L-HDBK-21  7B.  A 
literature  search  provided  the  latest  information  on  models  and  factors 
affecting  failure  rates.  The  most  notable  findings  from  the  literature  search 
included  several  reports  dealing  with  the  environments  to  which  avionic 
equipments  are  exposed  and  their  effects,  and  the  effects  of  equipment  age 
and  mission  duration  on  failure  rates.  Several  different  approaches  were 
used  to  quantify  the  nonoperating  failure  rate  characteristics  of  the  equip¬ 
ments  included  in  the  study.  These  approaches  included  direct  quantifica¬ 
tion  based  on  maintenance  data  analysis  (measured  failure  rates  based  on 
When  Discovered  codes)  and  indirect  quantification  using  regression  analysis 
methods  in  which  mission  duration,  duty  cycle,  and  parts  mix  were  used  as 
the  variables  of  interest.  Data  vectors  in  terms  of  matrices  were  developed 
based  on  the  available  data  and  the  requirements  from  the  models.  Follow¬ 
ing  this,  statistical  analyses  were  performed  leading  to  development  of 
nonoperating  failure  rate  indicators.  All  the  data  and  the  findings  from  the 
investigation  were  then  compiled  into  this  final  report. 
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Figure  2-t.  Flow  disgram  for  NOFRA  study. 


These  elements  are  described  in  the  following  sections.  The  data 
collection  is  described  in  Section  3.0  and  the  data  analysis  is  described  in 
Section  4.0.  The  analysis  results  are  summarized  in  Section  5.0  and  the 
conclusions  and  recommendations  are  presented  in  Section  6.0. 


3.0  INFORMATION  BASE 


3.1  EQUIPMENT  SELECTION 

A  representative  matrix  of  avionic  equipments  and  aircraft  weapon 
platforms  was  developed  for  establishing  the  equipments  to  be  included  in  the 
NOFRA  study.  The  criteria  used  for  equipment  candidate  selection  were 
similar  to  those  developed  for  the  OIR  study,  and  were: 

1  .  Equipment  must  be  of  recent  vintage;  as  defined  herein,  this 
means-post  1970. 

2.  The  design  of  the  equipment  must  be  characteristic  of  latest 
technology  in  circuits  and  packaging  techniques. 

3.  The  equipment  must  be  used  by  a  large  segment  of  the  Air  Force. 

4.  The  equipment  must  have  a  high  population. 

5.  The  equipment  selection  should  represent  a  broad  cross  section 
of  the  Air  Force  avionic  application. 

6.  The  equipment  must  be  one  designed  and  developed  under  a  con¬ 
tractual  reliability  program  plan. 

7.  The  equipment  must  be  one  on  which  AFM  66-1  Data  Products 
(Reference  14)  and  IROS  Reports  (Reference  15)  are  available. 

8.  The  equipment  should  be  one  on  which  MIL-STD-781  (Reference  16) 
reliability  demonstration  tests  were  conducted. 

9.  The  equipment  should  be  of  such  maturity  that  the  using  commands 
are  thoroughly  familiar  with  it,  and  there  is  no  learning  curve 
problem  in  maintenance  or  use. 

Additional  requirements  to  which  the  selected  avionic  equipments  were 
developed  are  included  in  specification  MIL-E-5400  (Reference  17)  and  MIL- 
STD-704  (Reference  18). 

The  final  selection  of  equipments  consisted  of  six  different  equipments 
representing  different  applications  on  fighter,  interceptor,  attack,  bomber, 
transport,  tanker,  and  trainer  aircraft.  Since  several  of  these  equipments 


are  used  on  two  or  more  different  weapon  systems,  a  totoal  of  32  different 
applications  (combinations  of  equipment  and  weapon  system)  are  included  in 
the  study. 

The  number  of  equipments  selected  was  limited  by  the  available 
resources  (manhours)  required  to  perform  the  new  predictions  and  compile/ 
reduce  the  field  operational  data.  The  specific  equipments  (identified  as  01 
through  06)  included  in  the  NOFRA  study,  and  the  weapon  platforms  or. 
which  they  were  used  are  shown  in  Table  3-1. 

TABLE  3-1.  EQUIPMENT/ WEAPON  PLATFORM  MATRIX 


Weapon  Platform  Types 


Equipment 
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s 

Bombers/ 

Transports 
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IT 

1 

Uh 

1 

1 

1 
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T-37 

T-  38 

T-  39 

B-52D 

B-52G 

B-52H 

C-130 
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1. 

ARN-118  TACAN 

X 

1 

X 

X 

X 

X 

X 

X 

B 

X 

X 

2. 

ARC-164  UHF  Radio 

X 

X 

X 

X 

1 

X 

X 

X 

X 

X 

E 

X 

X 

3. 

AAQ-6  FLIR 

I 

m 

X 

4. 

C-1108  Video  Monitor 

1 

X 

5. 

AYK-12  Computer 

X 

6. 

ARN- 13 IOMEGA  Nav. 

_ 

1 

1 

X 

This  matrix  represents  equipments  and  weapon  platform  combinations 
that  provide  a  data  set  wiiich  represents  the  different  avionic  functions  across 
the  two  dominant  platform  types  (fighters  versus  bombers)  which  were  iden¬ 
tified  as  having  significant  differences  by  the  OIR  study  results.  Furthermore, 
this  selection  is  much  more  recent  (1973)  than  used  on  the  OIR  study  (1969), 
and  provides  a  composite  data  matrix  including  more  than  26  applications  of 
the  six  equipment  types  on  17  different  weapon  platforms  for  the  data  base 
used  on  the  NOFRA  study.  This  matrix  includes  two  avionic  equipments  from 
the  OIR  study  and  four  new  equipments,  based  on  the  same  selection  rationale 
as  was  developed  on  the  OIR  study. 
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Two  of  the  equipments  selected,  the  ARN-118  TACAN  and  the  ARK- 131 
OMEGA  Navigational  Equipment,  were  developed  and  produced  under  RIW  , 

(Reliability  Improvement  Warrantee)  type  contracts.  Because  the  manu¬ 
facturers  implement  considerably  more  detailed  data  collection  and  analysis 
programs  than  is  normal  AFLC  practice  ,  it  was  anticipated  that  the  manu¬ 
facturer's  data  on  these  two  items  could  be  used  to  augment  the  AFLC  data 
on  these  equipments  for  analysis  purposes.  References  19  through  23  give 
additional  information  on  RIW  procurements  and  discuss  some  of  the  addi¬ 
tional  reporting  requirements  and  potential  problem  areas.  I 

The  selection  of  equipments  was  also  influenced  by  the  desire  for  a  ( 

reasonable  balance  between  the  two  dominant  weapon  platform  types  (bomber/  i 

tanker  versus  fighter/interceptor ).  A  second  matrix  indicating  the  distribu¬ 
tion  of  the  equipment  applications  by  weapon  platform  type  is  shown  in 
Table  3-2. 

Since  the  data  on  the  installed  inventory  of  equipments  01  and  02 
(ARN-118  TACAN  and  ARC- 164  UHF  Radio)  were  not  available  by  individual 
B-52  MDS  type,  the  three  applications  (B-52F,  B-52G  and  B-52H)  were 
treated  as  a  single  data  point,  hence  a  total  of  only  four  data  points  are 
indicated  in  the  subsequent  analysis  tables  for  the  B-52,  C-130,  KC-135  and 
C-141  aircraft  types.  Similarly,  the  data  for  the  TACAN  installations  (equip¬ 
ment)  on  the  F-111A,  E  and  F  models  were  treated  as  a  combined  data  point, 
resulting  in  only  five  data  points  for  the  fighter  applications  representing  the 
seven  applications  listed  in  Table  3-1.  As  can  be  seen,  the  resultant  balance 
consists  of  13  bomber/tanker  and  13  fighter /interceptor  platform  applications. 


TABLE  3-2.  EQUIPMENT/ WEAPON  SYSTEM  COMBINATIONS 


Because  of  the  need  for  additional  data  with  .which  to  characterize 
avionic  equipment  failure  characteristics,  data  on  two  additional  equip¬ 
ment  types  (07,  08)  taken  from  another  related  study  program  were  also 
analyzed.  The  data  on  these  equipments  are  included  in  the  analysis  data 
matrix  as  additional  information,  even  though  they  were  not  included  in  the 
originally  required  data  set  and  their  use  did  not  prove  helpful. 

3.2  TYPICAL  AVIONIC  EQUIPMENT  FIELD  CHARACTERISTICS 

To  better  understand  the  type  of  service  exposure  avionic  equipment 
must  withstand,  several  aspects  of  the  environments  to  which  the  equipments 
are  subjected  should  be  reviewed.  This  should  enable  the  reader  to  develop 
a  better  understanding  of  the  true  cyclic  nature  of  the  avionic  service  environ¬ 
ment,  as  well  as  a  practical  understanding  of  some  of  the  more  significant 
differences  that  preclude  extrapolation  of  experience  based  on  electronic 
equipments  in  other  use  environments. 

Dealing  first  with  the  broad  aspects  of  maintenance,  the  equipment  is 
not  subjected  to  an  ideal  environment  because  the  available  skill  levels, 
motivation,  training,  technical  manuals,  maintenance  facilities,  and  logistic 
support  resources  are  far  from  ideal.  An  excellent  report  on  the  subject 
(Reference  24)  discusses  the  ramifications  of  these  factors  based  on  a  recent 
field  study  by  an  ASD  team.  The  report  also  gives  some  excellent  comments 
on  the  nature  of  the  data  reflecting  avionics  maintenance  experience  and  some 
of  the  weaknesses  in  the  MDC  system.  Also  noted  is  the  fact  that  when 
avionic  equipments  are  operated  during  the  performance  of  maintenance  on 
the  ground,  they  are  sometimes  exposed  to  more  severe  thermal  environ¬ 
ments  than  those  normally  encountered  during  flight.  The  report  also  points 
out  that  because  of  ambiguities  and/or  suspect  performance  of  the  built  in 
test  (BIT)  function,  maintenance  personnel  frequently  are  forced  to  resort 
to  excessive  removal  and  replacement  actions  or  cannibalizations  to  restore 
a  faulty  system  to  an  operational  status.  These  excessive  maintenance 
actions  have  a  negative  effect  on  the  reliability  of  the  avionic  equipment. 


A  recent  study  by  Grumman  Aircraft  (Reference  25)  discusses  the 
influence  of  environmental  profiles  on  reliability  demonstration.  Among  the 
more  interesting  information  in  this  report  is  a  table  which  lists  mort  than 
30  different  potentially  degrading  environments  and  their  probable  effects  on 
avionic  equipment  performance.  For  reference  this  table  is  included  as 
Table  3-3.  The  significant  point  to  be  remembered  is  that  most  of  the  environ¬ 
ments  and  their  effects  are  equally  applicable  to  the  nonoperating  part  of  an 
avionic  equipments'  use  cys-le  when  installed  on  the  weapon  platform. 

Another  interesting  report  published  by  AFFDL  entitled  "Combined 
Environments  Reliability  Testing  of  the  AN/ARC- 164  Radio  Set"  (Reference 
26)  contains  quantitative  mission  profile  data  that  given  a  good  indication  of 
typical  values  encountered  during  flight  on  an  A-7D  aircraft  by  the  ARC- 164 
UHF  radio.  Several  of  the  A-7D  mission  profiles  are  included  in  Figures  3-1 
through  3-4. 

In  addition  to  the  environmental  profiles  during  flight,  avionic  equip¬ 
ments  are  also  subjected  to  daily  variations  in  temperature,  humidity,  air¬ 
borne  contaminants,  etc.  ,  while  the  aircraft  is  on  the  ground.  Depending  on 
the  geographical  location  of  the  aircraft,  these  temperatures  can  easily 
reach  +155°F  when  the  aircraft  is  parked  in  the  sun  with  the  canopy  and  bay 
doors  closed,  or  an  overnight  low  of  70  to  80°F  at  high  relative  humidities,  and 
can  form  heavy  condensation  on  the  exposed  surfaces  of  aircraft  in  the  south¬ 
western  desert  regions  of  the  United  States.  Alternatively,  the  extreme  cold 
temperatures  seen  in  the  Arctic  regions,  typically  -40°F  at  night  are  not 
unusual  for  aircraft  parked  in  exposed  areas.  Examples  of  these  daily  temper¬ 
ature  variations  for  missiles  under  similar  daily  temperature  cycles  are  given 
in  Figures  3-5  and  3-6.  The  examples  are  from  a  MICOM  report  (Reference  27) 
on  missile  storage  reliability  factors.  Although  the  MICOM  report  deals  with 
missile  system  components,  the  discussion  of  environments  and  failure 
mechanisms  is  also  applicable  in  many  respects  to  avionics.  However,  these 
findings  should  not  be  extrapolated  to  other  use  environments  because  of  the 
fundamental  differences  that  are  unique  to  each  of  the  different  use  environments 
and  the  design  approaches  and  constraints  used  for  each. 

The  available  literature  dealing  with  dormant  operating  and  storage 
effects  (References  27  through  35  inclusive)  deal  primarily  with  missile  sys¬ 
tem  components  and  their  respective  environments.  There  are  fundamental 
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TABLE  3-3.  POTENTIALLY  DEGRADING  ENVIRONMENTS  AND 
PROBABLE  EFFECTS  ON  AVIONIC  EQUIPMENT 


Component  damage.  funcli  'n#l 
mte  r  le  renc  e 

Electrical  degradation  i»horta, 
misalignment  I. 
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(Table  3-3,  concluded) 
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Figure  3-1.  A-7D  tropic  flight  measured  data,  right  avionics  bay. 
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Figure  3  2.  A  7D  tropic  flight  measured  data,  cockpit  radio  location  versus  right  bay. 


difference*  in  the  design  requirements,  objectives,  testing,  and  environments, 
etc.,  of  missile  system  components  viz-a-viz  avionic  equipment  components. 
Therefore,  a  rationale  cannot  be  developed  on  the  basis  of  which  failure  rates 
can  be  extrapolated  from  missile  system  use  environments  to  avionic  equip¬ 
ment  use  environments. 

The  reasons  for  the  foregoing  become  more  apparent  when  the  differ¬ 
ences  in  use  requirements  are  considered.  Missiles  are  generally  designed 
for  prolonged  periods  of  protected  storage  during  which  little  or  no  testing 
is  performed,  followed  by  a  one-shot  operational  mission.  Avionic  equip¬ 
ment  is  designed  for  10  to  15  years  of  intermittent  use  on  aircraft,  during 
which  time  many  cycles  consisting  of  operation  during  the  mission  followed 
by  a  period  of  nonoperation  between  missions  are  accumulated.  During  its 
service  life,  the  avionic  equipment  is  subjected  to  numerous  testing  and 
repair  cycles,  some  of  which  may  include  shipment  back  to  a  repair  depot 
half  way  around  the  world. 

Analysis  of  avionics  equipment  maintenance  data  collected  and 
analyzed  for  this  study  indicates  that  an  avionic  equipment's  cumulative 
environmental  life  cycle  exposure  profile  between  failure  occurrences  is 
between  15  and  160  use  cycles.  Each  use  cycle  consists  of  between  1.2  to 
8  hours  of  operating  time  during  a  flight  mission,  followed  by  a  nonoperating 
period  that  may  range  from  as  little  as  one-half  hour  to  as  long  as  90  days. 
During  this  period,  the  avionic  equipment  item  will  have  been  subjected  to 
an  additional  number  of  on-off  cycles  of  shorter  duration  while  maintenance 
i6  being  performed  during  ground  operating  time  on  the  weapon  platform. 

There  is  a  0.  9  probability  that  the  equipment  will  have  been  removed  from 
the  aircraft  each  time  a  failure  occurs,  sent  to  the  base  avionic  maintenance 
shop  for  repair,  and  subsequently  returned  to  base  supply  following  repair. 

The  equipment  may  spend  the  ■v'xt  several  days  or  months  in  base  supply, 
depending  on  the  resources  allocated  to  the  base.  Alternatively,  between 
2  and  20  percent  of  the  removed  LRUs  (line  replaceable  units)  are  sent  to  a 
repair  depot  for  corrective  maintenance.  In  the  interim,  the  aircraft  con¬ 
tinues  to  fly  its  missions  with  a  replacement  avionic  unit  of  like  type  that 
has  aiso  circulated  through  the  complex  supply  system  from  the  manufacturer 
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to  the  depot,  from  the  depot  to  airframe  prime  contractor  or  base,  from 
base  supply  to  the  base  avionics  maintenance  squadron  (AMS),  from  the  AMS 
to  the  aircraft  weapons  platform  or  the  depot,  and/or  from  the  aircraft 
weapon  platform  back  to  the  AMS. 

On  the  average,  the  equipment  will  have  experienced  one  failure  during 
this  time  interval  (15  to  160  cycles),  and  it  would  be  difficult  to  ascribe  the 
failure  to  a  specific  environmental  cause.  On  the  other  hand,  the  AFLC 
maintenance  and  operational  status  records  (AFM  66-1  and  AFM  65-110  data) 
could  be  interrogated  and  used  to  identify  when  and  where  the  failure  was 
discovered,  thereby  permitting  classification  of  the  failure  occurrence  as  a 
function  of  its  impact  on  mission  reliability,  mission  capability,  or  base  or 
depot  supply  resources. 

There  is  good  evidence  to  support  the  fact  that  the  nonoperating 
environment  of  the  equipment  when  installed  on  the  weapon  platform  is  con¬ 
siderably  more  severe  than  when  the  equipment  is  exposed  to  the  depot  or 
base  supply  environment.  It  is,  however,  an  academic  point  6ince  the  equip¬ 
ment  item,  at  the  actual  time  of  failure,  has  failed  as  a  result  of  the  cumu¬ 
lative  effect  of  its  previous  environmental  exposures.  This  cumulative 
exposure  effect  consists  of  many  individual  sequences  of  turn-on,  operation, 
turn-off,  and  non -operation,  so  that  the  precise  instant  of  failure  occurrence 
cannot,  in  reality,  be  ascribed  to  either  operation,  non -operation,  or  the 
turn-on  or  turn-off  interval.  It  might  be  considered  (in  the  absence  of  a 
pattern  failure  process)  that  the  actual  interval  during  which  the  failure 
occurs  is  in  fact  a  randomly  distributed  function. 

In  any  event,  the  end  effect  of  the  failure  occurrence  is  the  real  point 
of  interest,  and  this  can  be  categorized  as  being  either  "mission"  significant 
or  "operational  readiness"  significant  in  the  broad  sense.  The  mission 
significant  category  includes  all  failures  that  occur  after  the  weapon  system 
is  committed  to  a  mission,  having  successfully  completed  a  pre-flight  func¬ 
tional  check  by  the  aircrew.  The  operational  readiness  significant  category 
includes  all  failures  discovered  between  flights  or  during  the  preflight  checks 
by  either  the  groundcrew  or  aircrew  which  cause  the  system  to  be  classified 
as  Not  Mission  Capable  due  to  a  requirement  for  corrective  maintenance 
(NMCM).  Note  that  there  is  another  closely  related  category.  Not  Mission 
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Capable  due  to  lack  of  supplies  (NMCS),  which  also  can  affect  the  mission 
capable  rate  of  the  weapon  system  that  is  logistic  supply  related,  and  not 
directly  attributable  to  failure. 

In  summary,  it  is  seen  that  there  is  a  myriad  of  environments  and 
environmental  interactions  to  which  avionic  equipment  is  exposed  during  its 
service  life  cycle.  These  environments  vary  from  relatively  benign  long 
term  storage  to  extremely  severe  environmental  exposure  during  operational 
use  and/or  the  exposure  it  receives  during  transportation,  handling,  unpack¬ 
ing,  testing,  disbursement,  installation  on  the  aircraft,  and  the  performance 
of  subsequent  maintenance  actions.  Considering  the  differences  in  operational 
requirements  and  policies  amongst  the  various  operating  commands,  which 
have  a  direct  impact  on  maintenance  policies  and  their  implementation,  it 
is  not  at  all  surprising  that  considerable  variation  in  the  field  performance 
of  the  same  equipments  and/or  evidence  of  induced  damage  during  the  per¬ 
formance  of  maintenance  are  prevalent.  Therefore,  the  separation  of 
individual  enc ir onmental  factors  such  as  temperature,  vibration,  humidity, 
temperature  rate  of  change,  etc.  ,  and  the  quantification  of  the  effects  on 
failure  rate  of  these  sub-elements  of  the  combined  environments  becomes 
an  impossible  task, 

3.  3  FIELD  OPERATIONAL  DATA  COLLECTION 

This  study  was  based  on  the  use  of  available  historical  data  pertaining 
to  the  required,  predicted,  and  field  operational  reliability  performance  of 
selected  items  of  avionics  equipment.  The  data  used  were  obtained  after 
investigation  of  a  variety  of  data  collection  and  analysis  programs.  These 
AFLC  data  systems  (AFM  66-1,  AFM  65-110,  K051,  and  DOS6)  are  the  same 
as  those  used  previously  on  the  OIR  study.  The  data  sources  were  distri¬ 
buted  among  the  developing  (AFSC),  supporting  (AFLC),  and  operating 
commands  (ADC,  ATC,  MAC,  SAC,  and  TAC). 

Maintenance  and  operational  use  data  on  avionic  equipments  in  the 
current  operational  inventories  of  the  five  major  USAF  Operating  Commands 
(ADC,  ATC,  MAC,  SAC,  and  TAC)  on  19  different  aircraft  types  have  been 
collected,  analyzed,  and  summarized  at  the  LRU  and  equipment  levels. 

Although  it  was  desired  to  perform  assessments  at  the  component  part  type 
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level  also,  it  was  not  possible  to  do  so  for  the  following  reasons:  (1)  The 
available  data  on  parts  reflects  part  replacement  experience,  and  part 
replacement  data  cannot  be  related  to  part  failure  data;  (2)  The  part  replace¬ 
ment  data  cannot  be  related  to  the  original  discrepancy  occurrence  since  the 
data  required  for  traceability  (serial  number  of  equipment  and/or  original 
Job  Control  Number  of  the  maintenance  event)  are  not  maintained  in  the  data 
for  the  depot  repair  level,  where  the  majority  of  parts  replacements  are 
made;  (3)  Judging  from  the  fact  that  the  data  points  at  the  equipment  level 
hardly  provide  significant  statistical  data,  it  would  be  impossible  to  obtain 
sufficient  data  at  the  piece  part  level  to  show  statistically  justifiable 
conclusions . 

All  data  pertaining  to  the  field  operational  characteristics  are  based 
on  the  1-year  period  ending  31  December  1978,  and  represent  the  total 
weapon  system  inventory  performance  of  the  equipment  item  of  interest  (i.  e.  , 
total  force  performance  values  by  weapon  system  MDS)  while  operated  in  the 
continental  United  States.  The  reason  for  this  restriction  is  because  data 
from  overseas  bases  are  not  collected  and  subject  to  the  same  controls  as 
data  from  domestic  bases.  These  overseas  data  could  adversely  affect  the 
quality  of  the  data  base  as  well  as  introduce  other  variables. 

It  is  appropriate  to  list  a  warning  at  this  point:  Caution  must  be 
exercised  when  using  data  gathered  for  other  purposes  because  of  the 
inherent  uncertainty  which  arises,  i.e.,  the  AFLC's  MDC  system  was  never 
intended  to  be  used  as  a  reliability  assessment  tool;  it  was  designed  to  serve 
the  needs  of  the  logistic  support  community,  and  any  inferences  made  rela¬ 
tive  to  the  reliability  performance  of  hardware  based  on  MDCS  data  must 
recognize  the  limitations  of  these  data  and  the  purpose  for  which  they  were 
collected. 

The  quality  of  data  obtained  varied  widely  relative  to  study  needs, 
thereby  imposing  some  limitations  on  the  number  of  applications  included  in 
this  study.  Also,  data  on  some  of  the  desired  factors  were  unavailable  and 
consequently  these  factors  could  not  be  included  in  the  final  analysis.  Never¬ 
theless,  although  some  weapon  system  applications  of  the  equipments  included 
in  the  study  had  to  be  dropped,  the  final  data  matrix  characterizing  the  field 


experience  consists  of  26  combinations  of  equipment  and  weapon  system 
(aircraft)  type. 

In  addition  to  the  data  on  the  six  equipment  types  included  in  the  study, 
data  on  two  additional  equipment  types  were  also  collected  and  analyzed  in 
an  attempt  to  increase  the  data  sample  size  and  gain  additional  insights  into 
the  relationships  being  investigated  on  the  NOFRA  study. 

Field  operational  reliability  values  were  derived  from  AFM  66-1  MDC 
system  data  (Reference  10),  from  AFM  65-110  data  (Reference  13),  from 
K051  system  data  products  (Reference  15),  and  from  D056  Product  Perfor¬ 
mance  System  data  products  (Reference  14).  Logistics  performance  factors 
were  obtained  using  the  methods  described  in  AFLCM  800-3  (Reference  36). 

The  input  data  from  AFLC  D056  and  AFM  65-110  data  files  were 
extracted,  validated,  and  entered  into  the  computer  file  for  analysis  and 
derivation  of  the  required  factors  using  the  same  methods  and  analysis 
programs  (software)  developed  for  the  OIR  study.  These  data,  once  reduced 
and  summarized,  were  used  to  derive  the  field  operational  factors  such  as 
operating  time,  nonoperating  time,  the  number  of  failures  and  maintenance 
actions  during  both  operating  and  nonoperating  time  periods,  the  flying  hours, 
mission  durations,  and  the  utilization  rates  of  each  equipment/weapon  system 
applications  included  in  the  study. 

3.4  DATA  BASE  COMPILATION 

The  results  of  the  field  operational  data  collection  and  analysis  task 
provided  an  ordered  data  file,  containing  the  required  factors  for  assessing 
the  operating  and  nonoperating  failure  characteristics  of  avionic  equipment 
at  the  equipment  and  LRU  levels.  All  of  the  factors  and  parameters  utilized 
in  this  study  are  defined  in  Section  7  entitled  "Definitions.  " 

The  following  paragraphs  explain  the  methods  used  for  deriving  a 
number  of  the  more  important  factors  and  parameters  relating  to  equipment 
use  characteristics  for  the  items  of  interest  to  this  study. 


3-15 


m 


3.4.1  Classification  of  Field  Failures 

Each  field  failure  was  classified  into  either  an  "operating"  or 
"nonoperating"  failure  by  using  the  when  discovered  code  (WDC)  reported  on 
the  maintenance  action  record  for  each  failure  occurrence  against  a  given 
work  unit  code  (WUC)  as  shown  in  Figure  3-7.  The  WDC  reflects  when 
the  failure  was  discovered  (i.  e.  ,  detected),  and  not  when  the  failure  actually 
occurred.  Using  these  data  for  nonoperating  failure  rate  calculations  pre¬ 
sumes  that  the  period  during  which  the  failure  occurred  is  the  same  as  the 
one  in  which  it  was  detected.  This  calculation  will  give  an  approximation  to 
the  nonoperating  failure  rate  based  on  field  maintenance  data. 

It  should  be  recognized  that  some  error  in  the  assessed  failure  rates 
for  operating  and  nonoperating  categories  may  exist.  This  is  because  some 
failures  that  occur  during  nonoperating  time  while  the  aircraft  is  on  the 
ground  may  not  be  detectable  until  after  the  mission  begins,  just  as  some 
failures  that  may  occur  during  the  mission  may  not  be  detected  until  the  next 
check  when  the  aircraft  is  on  the  ground.  Discussions  with  operations  and 
maintenance  personnel  regarding  the  possible  error  magnitude  and  direction 


Figure  3-7.  Operating  vs.  nonoperating 
failure  classification. 
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indicate  that  the  possible  error  would  tend  to  cause  the  nonoperating  failure 
rate  to  be  somewhat  lower  than  the  true  value.  The  magnitude  of  the  error 
depends  primarily  on  the  degree  to  which  it  is  possible  to  perform  a  valid 
functional  test  of  a  given  equipment  while  the  aircraft  is  on  the  ground. 

Clearly,  for  some  equipments  such  as  a  command  radio,  which  is 
in  use  for  some  time  before  aircraft  takeoff,  functional  failures  or  discrep¬ 
ancies  would  quite  likely  be  detected  on  the  ground.  On  the  other  hand,  many 
failures  of  TACAN  equipment  or  inertial  equipments  are  not  detectable  on 
the  ground,  and  hence  these  would  almost  always  be  detected  during  flight 
(and  classified  as  operating  failures)  even  though  some  of  them  may  have 
occurred  during  operating  time. 

Since  there  are  no  other  available  data  that  report  the  actual  time  of 
failure  on  avionic  equipments,  and  the  study  was  limited  to  making  use  of 
existing  data  records,  the  WDC  for  each  occurrence  was  used  to  classify 
failures  into  operating  and  nonoperating  categories. 

Analysis  of  the  AFM  66-1  MDC  system  data  records,  using  the  Hughes 
developed  analysis  programs,  permitted  a  rapid  assessment  to  be  made  of 
the  total  number  of  operating  and  nonoperating  failures  for  each  equipment 
WUC  by  month  and  year,  so  that  the  pertinent  summary  statistics  such  as 
percent  operating  failures  and  percent  nonoperating  failures,  and  the  respec¬ 
tive  values  of  MTBF,  failure  rates  and  failure  rate  ratios  could  be  derived. 

3.4.2  Equipment  Use  Factor  Calculations 

3.4.  2.1  K  Factor  Calculations 

For  the  equipments  investigated  the  D056  system  gives  values  of  1.00 
for  their  K  factors  (the  operating  hours  to  flight  hours  ratio),  thereby  causing 
the  resultant  D056  reported  values  of  MTBF  to  be  based  on  equipment  flight 
hours,  not  equipment  operating  hours.  An  analytical  method  was  used  to 
derive  the  equipment  K  factors.  This  model  was  developed  on  the  previously 
completed  OIR  study  (Reference  6).  This  model  takes  into  account  the  real¬ 
time  elements  that  collectively  constitute  the  total  equipment  operating  time, 
and  permits  the  derivation  of  an  estimated  K  factor  that  is  in  close  agreement 
with  measured  values. 


The  model  for  calculation  of  the  equipment  use  factor  (K)  is 


/MT  +  GT\  ....  /MMHRS  -  (lx  TMA) 
K  =  ( - MD  /  +  °*45  ( - EFHRS - , 


MT  =  Mission  operating  time  on  equipment  (Hours) 

GT  =  Equipment  ground  operating  time  (Hours)  per  mission 
MD  =  Mission  flight  duration  (Hours) 

MMHRS  =  Maintenance  manhours  on  equipment  (Hours)  per  year 

TMA  =  Total  on  equipment  maintenance  actions  (WUCXX  level) 
per  year 

EFHRS  =  Equipment  flight  hours  (Hours)  per  year. 

The  first  term  of  the  model,  (MT  +  GT)/MD  is  the  ratio  of  equipment 
operating  time  to  flight  time  that  the  equipment  accumulates  during  mission 
flight.  The  GT  term  accounts  for  the  operating  time  that  the  equipment 
accumulates  during  the  air-crew  pre-flight  checkout,  systems  startup,  and 
ground  taxi  and  run-up  operations,  as  well  as  the  time  accumulated  after 
landing  during  ground  taxi,  post-flight  checks,  and  system  shutdown.  The 
specified  values  of  ground  operating  times  were  obtained  by  reviewing  the 
actual  real  time  sequence  of  events  from  equipment  turn-on  to  equipment 
turn-off  w  ith  flight  crews  representing  each  of  the  different  weapons  systems 
included  in  the  study. 

Note  that  the  equation  developed  provides  a  means  for  including  the 
weapon  system  flying  time  and  ground  operating  time  variables,  and  that  the 
equipment  mission  operating  time  can  be  less  than  the  mission  duration  for 
those  cases  where  an  equipment  is  operated  during  only  part  of  the  mission 
duration.  For  those  equipments  included  in  this  study,  all  equipments  are  on 
for  the  entire  mission  duration,  hence  MT  =  MD. 

The  second  term  of  the  model,  0.45  (MMHRS  -  (lx  TMA)/EFHRS) 
accounts  for  the  equipment  operating  time  accumulated  while  maintenance  is 
being  performed.  The  term  (MMHRS  -  (lx  TMA))  is  the  adjusted  value  of 
maintenance  manhours  that  represents  the  active  maintenance  manhours, 
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which  when  divided  by  EFHRS  yields  active  maintenance  manhours  per  flight 
hour.  The  adjustment  (1  x  TMA)  is  necessary  to  reduce  the  total  number  of 
maintenance  manhours  by  deducting  1  hour  per  maintenance  action  (non¬ 
productive  time)  from  the  total  to  derive  the  active  maintenance  manhours. 
The  constant  0.45  is  an  empirical  constant  which  represents  the  fraction  of 
the  active  maintenance  index  during  which  the  equipment  is  operating  (i.e.  , 
45  percent). 

1.4,2.  2  Mission  Duration  (MD)  Calculations 

Since  the  D05o  system  does  not  give  mission  duration  values,  these 
values  had  to  be  calcuated  for  each  of  the  equipments  and  weapon  systems 
included  in  the  study.  This  was  done  so  that  the  influence  of  mission  dura¬ 
tion  on  operational  reliability  could  be  assessed  using  the  analytical  methods 
developed  for  the  study.  The  equation  used  for  the  calculation  of  average 
mission  duration  is 


MD 


FHRS 
Sortie  s 


where: 

FHRS  =  Total  annual  weapon  system  flight  hours 

Sorties  =  Total  annual  weapon  system  sorties. 

3.4.  2.  3  Utilization  Rate  (UR)  Calculations 

Since  the  D056  system  does  not  give  utilization  rate  UR  (number  of 
weapon  system  flight  hours  per  system  per  month)  values,  these  values  had 
to  be  calculated  for  each  of  the  equipments  and  weapon  systems  included  in 
the  study.  This  was  done  so  that  the  influence  of  utilization  rates  on  opera¬ 
tional  reliability  could  be  assessed  using  the  analytical  methods  developed 
for  the  study.  The  equation  used  for  the  calculation  of  average  weapon  sys¬ 
tem  utilization  rate  is 


UR 


FHRS 
12  (ENV) 


where: 


FHRS  =  total  annual  weapon  system  flight  hours 
INV  =  average  annual  weapon  system  inventory. 

3.  4 .  2 .  4  Derivation  of  Equipment  Operating  Hours  (EOHRS) 


The  total  annual  equipment  operating  time  (EOHRS)  values  were  cal¬ 
culated  based  on  the  reported  values  of  weapon  system  flight  hours  (FHRS) 
reflected  by  AFM  65-110  records,  the  number  of  equipments  per  aircraft 
(QPA),  and  the  equipment  use  factor  (K)  which  was  explained  in  Paragraph  3.4. 2.1, 
The  model  used  for  calculating  time  was  as  follows: 

EOHRS  =  (FHRS)  (QPA)  (K) 

These  operating  time  values  were  derived  for  the  1-year  data  window 
for  the  period  ending  31  December  1978.  In  those  cases  where  the  equipment 
of  interest  was  not  installed  on  all  active  aircraft  of  a  given  MDS  (i.e.,  partial 
inventory  installations),  the  annual  operating  time  values  were  calculated 
using  the  ratio  of  installed  inventory  to  aircraft  inventory  as  a  means  of 
estimating  the  EFHRS  for  each  month  during  the  period  of  interest,  and  then 
summing  the  monthly  values  to  derive  the  annual  value. 

3.  4. 2 .  5  Derivation  of  Equipment  Nonoperating  Time 

The  total  annual  equipment  nonoperating  time  (NOPTIME)  values  were 
calculated  based  on  an  average  month  (of  730.  5  hours)  and  the  assumption 
that  the  number  of  equipments  in  the  supply  inventory  were  10  percent  of  the 
number  of  installed  equipments.  This  assumption  was  necessary  because  the 
required  data  on  supply  inventory  by  calendar  month  and  weapon  system  MDS 
were  not  available.  The  consensus  recommendations  from  the  various  inve- 
tory  managers  and  system  managers  at  the  ALCs  contacted  during  the  study 
were  that  using  a  10  percent  factor  would  probably  be  more  accurate  than 
what  could  be  achieved  by  a  detailed  inquiry. 


Since  the  operating  time  values  were  calculated  for  the  installed 
inventory  as  explained  in  Paragraph  3.  4. 2. 4,  and  the  installed  inventory 
values  were  also  known,  the  nonoperating  time  values  were  calculated  using 
the  following  model: 

NOPTIME  =  (12)  (730.5)  (INV)  (QPA)  (1.1)  -  (EOHRS) 

where  INV,  QPA  and  EOHRS  are  as  previously  defined. 

3.4. 2. 6  Derivation  of  Equipment  Field  Reliability  Characteristics 

The  methods  used  for  the  derivation  of  the  field  reliability  character¬ 
istics  of  each  equipment  of  interest  used  the  classical  model  for  derivation  of 
monthly  and  annual  values  of  MTBF  according  to  the  following  formula: 


MTBF 


Time 
F  ailures 


where  the  values  of  time  and  failures  are  either  for  the  total,  operating,  or 
nonoperating  time  periods.  For  purposes  of  analysis,  the  failure  rate  (\, 
the  inverse  of  MTBF)  is  used  in  the  subsequent  analysis  section. 

3.4.3  Assessment  of  Field  Failure  Characteristics 

The  field  reliability  assessments  based  on  analysis  of  maintenance 
records  for  each  of  the  26  equipment/weapon  system  applications  included  in 
ti.e  study  were  performed  using  computer  programs  originally  developed  in 
support  of  the  OIR  study.  These  programs  analyze  AFM  66-1  MDC  system 
data  for  any  given  combination  of  equipments  and  weapon  systems  and  gen¬ 
erate  an  output  report  for  the  desired  time  interval  (in  months)  and  period 
ending  date  (year /month).  This  field  data  analysis  summary  (FDAS)  report 
includes  all  pertinent  factors  desired  for  each  equipment  item  at  both  the 
1.RU  and  equipment  functional  levels  as  identified  by  the  WUC  structure  of 
each  weapon  system.  An  example  FDAS  report  is  included  in  Appendix  B  for 
the  ARN-118  TACAN. 
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The  criteria  used  for  field  reliability  assessments  are  the  same  as  are 
used  by  HQ  AFLC  for  the  D056  Product  Performance  summary  reports  as 
defined  in  AFLCM  66-15  (Reference  14).  The  FDAS  report  is  generated  in 
three  segments  which  report  on  total  failures,  operating  failures,  and  non¬ 
operating  failures,  respectively,  and  contain  all  required  factors  for  deriv¬ 
ing  the  reliability  characteristics  in  support  of  the  NOFRA  study  objectives. 

For  purposes  of  reliability  assessment  based  on  MDC  system  data, 
the  D056  definition  of  a  "failure-1  is  based  on  classifying  the  data  into  one  of 
three  "Type  How  Malfunctioned"  codes  and  then  classifying  all  "Type  1  How 
Malfunctions"  reported  in  combination  with  an  action  taken  indicating  repair, 
adjustment,  or  item  replacement  and  one  or  more  units  produced,  as  a  "fail¬ 
ure.  "  All  remaining  Type  1  How  Malfunctioned  actions  are  classified  as 
"Other  Type  1  How  Malfunctions"  and  are  not  used  in  calculating  MTBF.  The 
definitions  of  "Type  1,  2,  or  6  How  Malfunctioned"  Codes  are 

1.  Type  1  —  These  codes  indicate  that  the  item  no  longer  can  meet 

the  minimum  specified  performance  requirement  due 
to  its  own  internal  failure  pattern. 

2.  Type  2  —  These  codes  indicate  that  the  item  can  no  longer  meet 

the  specified  performance  requirement  due  to  some 
induced  condition  and  not  due  to  its  own  internal  fail¬ 
ure  pattern. 

3.  Type  6  —  These  codes  indicate  maintenance  resources  were 

expended  due  to  policy,  modifications,  item  location, 
cannibalization  and  other  no  defect  conditions  existing 
at  the  time  maintenance  was  accomplished. 

The  method  used  for  the  classification  of  maintenance  actions  into 
"Failures"  in  the  D056  analysis  system  is  illustrated  in  Figure  3-8. 

The  field  operational  performance  characteristics  (summarized  in 
field  data  summaries)  were  analyzed  and  reviewed  to  extract  data  and  to 
identify  factors  relevant  to* readability  performance,  using  the  methods  out¬ 
lined  in  AFLCM  66-15  for  the  derivation  of  equipment  MTBF.  All  data 
master  records  were  checked  to  verify  the  validity  of  the  factors  used  in  the 
data  analysis  program,  anu  to  identify  any  anomalies  or  errors  in  the  data 
base.  As  an  adjunct  to  the  analysis  of  MDC  system  data,  a  number  of  opera¬ 
tional  air  bases  were  visited  to  establish  direct  contact  with  base  level 


Figure  3-8.  D056  maintenance  action  classification. 


avionics  maintenance  personnel,  maintenance  operations  personnel,  data 
management  personnel,  flight  operations  personnel,  and  quality  control 
personnel. 

Through  these  visits  and  the  use  of  Hughes  field  service  representa¬ 
tives  at  various  other  bases,  a  good  understanding  was  developed  of  the  nor¬ 
mal  sequence  of  events  pertaining  to  the  performance  and  documentation  of 
maintenance  actions,  the  maintenance  policies,  and  the  options  within  the 
maintenance  data  reporting  system  available  to  the  supporting  and  operating 
command  personnel. 

The  measured  and  derived  factors  based  on  the  analysis  of  D056E 
data  are  listed  in  Tables  3-4  and  3-5  respectively.  From  these  data  files 
the  pertinent  measured  values  such  as  number  of  failures,  flight  hours, 
QPAs,  etc.  were  derived  and  are  summarized  for  each  of  the  equipment/ 
aircraft  platform  combinations  investigated  in  the  study.  The  composite 
results  of  the  measured  data  for  each  of  the  26  equipment/aircraft  platform 
applications  are  given  in  Table  3-6.  In  addition  to  equipments  01  through  06, 
data  are  also  included  for  two  additional  equipments  (07  and  08)  which  were 
added  to  the  data  base  in  an  attempt  to  gain  additional  insights  into  the 
characteristics  of  interest.  Equipments  07  and  08  were  the  AN/APN-167 
radar  altimeter  and  air  data  computer  respectively,  and  were  used  on  the 
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TABLE  3-4.  MEASURED  FACTORS  FROM  D056 
DATA  ANALYSIS 


Symbol 

Measured  Factors 

INV 

Weapon  System  Inventory 

FHRS 

Weapon  System  Flight  Hours 

QPA 

Equipment  Quantity  per  Aircraft 

K 

Equipment  K  Factor  (Operating  Hours/Flight  Hour) 

MD 

Mission  Duration  (Hours) 

UR 

Weapon  System  Utilization  Rate  (FHrs/Month/ Aircraft) 

MI 

Maintenance  Index  (Maintenance  Manhours /FHr.  ) 

F  TOT 

Number  of  Total  Failures 

FOP 

Number  of  Operating  Failures 

FNOP 

Number  of  Nonoperating  Failures 

TMAS 

Total  Maintenance  Actions 

REMS 

Number  of  Removals 

NRTS 

Not  Repairable  This  Station  (Return  to  Depot  or  SRA) 

TABLE  3-5.  FACTORS  DERIVED  FROM  D056 
EXTRACTED  VALUES 


Symbol 

Derived  Factors 

'.NOP 

Percentage  Nonoperating  Failures 

MTBFTOT 

MTBF  in  Eq.  Op.  Hrs.  for  Total  Failures 

MTBFOP 

MTBF  in  Eq.  Op.  Hrs.  for  Operating  Failures 

MTBFNOP 

MTBF  in  Eq.  Nonoperating  KHrs.  for  Nonoperating  Failures 

LAMTOT 

Total  Failure  Rate  (Lambda)  (failures  per  million  hours) 

LAMOP 

Operating  Failure  Rate  (failures  per  million  hours) 

LAMNOP 

Nonoperating  Failure  Rate  (failures  per  million  hours) 

TOT/NOP 

Ratio  of  Total  to  Nonoperating  Failure  Rates 

OP/NOP 

Ratio  of  Operating  to  Nonoperating  Failure  Rates 

EUR 

Equipment  Utilisation  Rate  (Eq.  Op.  Hrs.  /Month/Eq.  ) 

%optime 

Percentage  of  Operating  Time  Relative  to  Calendar  Time 

F.'KSRTY 

Failures  per  Thousand  Sorties 

AGEHOURS 

Equipment  Age  in  Operating  Hour';  at  End  of  Time 

F-111A,  D,  E,  F,  and  FB-111A  series  aircraft.  To  facilitate  the 
identification  of  the  aircraft  weapon  system  associated  with  each  equipment 
type,  a  two-character  weapon  system  (WS)  designator  is  included  in  the  first 
column  of  Tables  3-6  and  3-7  for  each  data  entry.  The  first  character  of 
this  designator  indicates  the  aircraft  type  (i.  e. :  A  =  Attack,  B  =  Bomber, 

C  =  Cargo,  F  =  Fighter /Inter ceptor,  T  =  Trainer).  The  second  character 
of  the  WS  designator  indicates  a  specific  aircraft  MDS,  such  as  F-15A,  T-38, 

C - 1 4 1 ,  etc. 

From  the  data  given  in  Table  3-6,  the  composite  failure  characteristics 
( i .  e .  ;  failure  rates,  MTBFs,  percent  nonoperating  failures,  etc.  )  were 
derived  using  the  methods  described  in  paragraph  3.4.2.  The  results  sum¬ 
marizing  the  derived  equipment  failure  characteristics  are  given  in 
Table  3-7.  These  two  Tables  (3-6  and  3-7)  constitute  the  data  base  used 
for  the  analyses  described  in  Section  4.  0  of  this  report.  Since  these  data 
represent  the  observed  field  failure  characteristics  (as  compared  with  the 
predicted  values),  the  terms  measured  MTBF,  etc.  ,  will  be  associated  with 
these  values  whenever  they  are  referred  to  in  subsequent  sections  of  this 
report. 


TABLE  3-6.  ANALYSIS  DATA  BASE  -  MEASURED  EQUIPMENT  CHARACTERISTICS 


AIRCRAFT  TYPE  LEGEND!  R  -  ROHM  R/TRANGPIIRT  r  F  -  F  inHlrR/INIFRCEP  (OR/'lhAlfH  U 


4.  0  ANALYSIS 


Several  different  approaches  were  used  to  perform  analysis  tasks  to 
develop  the  failure  rate  data  for  the  six  equipments  included  in  the  study  as 
shown  in  Figure  4-1. 

The  first  approach  was  to  develop  predicted  operating  and  non¬ 
operating  failure  rates  using  the  methods  and  data  given  in  MIL-HDBK-21  7B, 
and  two  other  nonoperating  failure  rate  prediction  methods  developed  by 
RADC  and  MIRADCOM. 


Figure  4-1.  Analysis  Task  Diagram 


The  second  approach  developed  the  same  two  parameters  using  field 
maintenance  data  and  performing  analyses  based  upon  classification  of 
failures  into  operating  or  nonoperating  failure  categories  using  the  When 
Discovered  (WD)  codes.  From  these  data,  the  measured  field  failure 
rates  (Xqp>  *or  eac^  °*  t*'e  26  different  applications  of  the  six  equip¬ 

ment  types  of  interest  were  derived.  A  review  of  the  data  indicated  that  three 
of  the  26  applications  on  which  the  data  were  computed  had  insufficient  experi¬ 
ence  to  permit  inclusion  in  the  analysis.  These  were  applications  which  had 
an  average  inventory  of  100  or  less  operational  equipments  during  the  time 
period  of  interest.  The  applications  excluded  for  this  reason  were  the 
ARN-118  TACANs  on  the  T-39  aircraft  and  the  ARC- 164  UHF  radios  on  the 
C-141  and  F-101  aircraft.  Unless  otherwise  specified  all  subsequent  discus¬ 
sions  and  analyses,  are  based  on  the  resultant  (censored)  data  set  of  23 
applications.  From  these  values,  average  operating  and  nonoperating  failure 
rate  values  for  each  of  the  six  equipment  types  were  developed  for  comparison 
with  the  predicted  failure  rate  values  discussed  previously. 

The  third  approach  to  estimation  of  nonoperating  failure  rates  was 
based  on  two  different  types  of  regression  analysis  models  in  which  the  field 
data  characterizing  the  total  failure  rates  were  analysed  in  such  a  way  that 
the  contribution  of  nonoperating  failure  rates  could  be  assessed  using  the 
models.  These  regression  models  used  mission  duration  (MD)  and  duty 
cycle  (DC)  as  the  independent  variables  from  which  the  desired  failure 
rates  were  derived. 

The  methods  used  for  each  of  the  analysis  tasks  and  results  obtained 
are  described  in  this  section,  A  summary  of  the  analysis  results  and 
inferences  to  be  drawn  are  included  in  Section  5.  0  of  this  report. 


4.  1  RELIABILITY  PREDICTIONS 

4.  1.  1  Equipment  Reliability  Prediction  Assessments 

The  detailed  reliability  prediction  reports  for  each  of  the  six  equip¬ 
ments  included  in  the  study  were  obtained  from  the  original  equipment  manu¬ 
facturers  for  review  and  analysis.  A  review  of  the  prediction  reports 
revealed  that  the  equipment  manufacturers  used  a  variety  of  government 
sources  for  failure  rates,  ranging  from  MIL-HDBK-2  1  7 A  to  MIL- HDBK- 2  1 7 B, 
and/or  their  own  internal  failure  data  sources.  Furthermore,  each  manu¬ 
facturer  tended  to  apply  his  own  ground  rules  when  making  predictions. 

Because  these  prediction  analyses  were  prepared  under  a  variety  of  ground 
rules  and  requirements,  it  was  necessary  to  prepare  a  new  reliability  pre¬ 
diction  assessment  for  each  of  the  six  equipments  so  that  a  common  reliability 
prediction  baseline  in  accordance  with  MIL-HDBK-2  17B  could  be  established 
in  support  of  the  study  analysis  tasks. 

The  predicted  operational  reliability  of  each  of  the  equipments  included 
in  the  study  was  reassessed  using  the  methods  in  MIL-HDBK -2 1  7B  and  other 
appropriate  data  for  those  items  not  included  in  MIL-HDBK -2  1  7B.  This 
task  was  performed  at  the  equipment  and  LRU  levels  using  a  computerized 
reliability  prediction  program  based  on  MIL-H DBK -2 1  7B  developed  by 
Hughes  known  as  ASRAP  (Assumed  Stress  Reliability  Analysis  Program! 

The  ASRAP  series  of  programs  provide  for  rapid  calculations  of 
system  failure  rate  and  MTBF  within  a  specified  use  environment  under  vary¬ 
ing  conditions  of  temperatures,  stress,  and  part  quality.  The  computer  pro¬ 
gram  includes  complex  failure  rate  equations  for  each  part  type.  The  elements 
of  each  equation  consist  of  a  base  failure  rate  (X^)  predicted  on  thermal  and 
electrical  stress  and  a  series  of  adjustment  factors  to  account  for  the  use 
environment,  quality  level,  design  ratings,  etc.  As  an  illustration,  consider 
the  failure  rate  equation  for  a  transistor: 

kp  ■  <Xbl(T!EHiTA 
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where: 


X  =  Total  part  failure  rate 
P 

V  =  Base  failure  rate 

D 

=  Environmental  use  factor 
E 

rr^  =  Application  factor 
^  =  Quality  factor 
^  =  Power  rating  factor 
=  Voltage  stress  factor 
it  =  Complexity  factor. 

This  detailed  approach  to  part  failure  rate  determination  is  typical  of  the 
equations  used  in  failure  rate  sources  such  as  MIL-HDBK-217B,  which  are 
included  in  the  ASRAP  program. 

The  use  of  the  ASRAP  program  provided  the  required  baseline 
predictions  for  each  of  the  NOFRA  study  equipments  in  accordance  with 
MIL-HDBK-2  17B,  thereby  assuring  a  uniform  prediction  baseline  for  each 
of  the  six  equipments  included  in  the  study. 

4.  1.2  Ground  Rules  and  Assumptions 

It  was  necessary  to  establish  a  standard  set  of  ground  rules  and 
assumptions  where  MIL,-HDBK-21  7B  did  not  include  failure  rates  for  cer¬ 
tain  parts  included  in  this  study.  These  criteria  were  applied  to  all  of  the 
selected  equipments  and  used  to  establish  the  common  baseline  predictions: 

1.  In  several  instances  (capacitors  and  high  stress  ratio  diodes), 
values  for  certain  parameters  (stress  ratio  versus  temperature) 
were  of  a  magnitude  not  available  from  the  curves.  The  RADC 
Notebook  (Reference  38)  was  used  in  these  cases. 

2.  Equipment  manufacturer  failure  rates  were  utilized  in  those  few 
instances  where  a  device  was  considered  proprietary  by  a  manu¬ 
facturer  and  no  information  was  available. 

3.  The  application  factor  for  Group  I  and  II  transistors  was  assumed 
to  be  linear  unless  the  device  was  used  as  a  logic  switch. 


4.  The  voltage  stress  for  Group  I  Transistors  was  established  at 
60  percent,  because  precise  stress  values  were  not  available. 

5.  Insert  material  for  connectors  was  assumed  to  be  Type  A  unless, 
otherwise  stated  or  known  (coax). 

6.  Voltage  stress  ratios  for  Group  IV  diodes  were  defined  as  IC'0 
percent. 

7.  Unless  otherwise  known,  filter  configurations  were  assumed  to 
be  Pi. 

8.  An  application  factor  of  2.  0  was  assigned  to  '  C  Y''  capacitors 
having  a  capacitance  greater  than  10,000  pFd. 

9.  Hybrid  thin  film  equations  were  used  to  determine  failure  rates 
of  resistor  networks. 

4.  1.  3  Predicted  MTBF  Assessment  Results 

The  ASRAP  program  was  run  to  derive  the  predicted  MTBF  values 
for  each  of  the  six  equipments  under  its  nominal  operating  conditions,  and 
then  run  again  for  different  levels  of  stress,  temperature,  and  environment 
representing  the  nonoperating  condition  for  each  equipment. 

Although  MIL- HDBK  -  2  1  7B  explicitly  cautions  against  the  extrapolation 
of  the  failure  rate  models  for  components  to  the  zero  stress  level,  an  estimate 
was  made  of  the  nonoperating  MTFB  using  this  method  so  that  a  first  order 
prediction  might  be  obtained  for  informational  purposes.  This  was  done 
using  the  environmental  use  factor  for  Ground  Fixed  equipment  at  the  zero 
stress  level  and  at  a  temperature  of  30°C  which  was  judged  to  be  the  best 
approximation  to  the  avionic  equipment's  nonoperating  environment. 

A  summary  of  the  results  of  these  analyses  and  the  values  for  the 
original  MTBF  predictions  performed  by  the  equipment  manufacturers  for 
each  of  the  six  equipments  included  in  the  study  is  given  in  Table  4-1.  It  is 
evident  that  the  results  of  the  zero  stress  level  analysis  are  unrealistically 
high  by  at  least  an  order  of  magnitude,  when  compared  to  the  known  field 
experience.  In  part,  this  may  be  due  to  the  influence  of  the  fixed  special 
part  failure  rates  used  for  items  not  included  in  MIL-HDBK - 2 1  7B,  which  do 
not  change  as  a  function  of  stress  or  environment. 


TABLE  4-1.  REPREDICTED  MTBF  ASSESSMENT  RESULTS 


Equipment 

Number 

Equipment 

Manufacturer's 

Predicted 

MTBF 

Hughes 
Predicted 
Baseline  MTBF 

(^op)'1 

■ 

* 

Predicted 

Nonoperating 

MTBF(Xnop  ) "  ^ 

Ratio 

XOP/XNOP 

01 

1,092 

1,205 

3,406 

2. 83 

02 

3,075 

3,457 

7,623 

2.21 

03 

142 

236 

1,349 

5.72 

04 

1,014 

2,633 

3,915 

1.49 

05 

1, 437 

2,  732 

9,  41  1 

3.  44 

06 

1,118 

1,  274 

1,  944 

1 .  53 

Based  on 

MIL -HD  BK-2  17B 

♦ 

Also  included  in  Table  4-1  is  the  ratio  of  each  equipment's  pre¬ 
dicted  operating  to  nonoperating  failure  rate  for  subsequent  comparison 
with  the  measured  ratio  of  the  same  parameters  based  on  field  maintenance 
data  analysis. 

By  examining  the  results  obtained,  it  is  clear  that  the  relatively  low 
ratios  of  operating  to  nonoperating  failure  rates  do  not  seem  reasonable. 

Other  variables  to  consider  are  the  inconsistencies  in  the  criteria  used  for 
the  determination  of  relative  parts  count  and  complexity  factors,  and/or  the 
inclusion  of  special  part  failure  rates  for  those  parts  not  included  in 
MIL  -  HD BK-2 17B. 

After  a  careful  review  of  the  details  of  each  zero  stress  prediction 
analysis,  it  was  observed  that  a  considerable  part  of  the  nonoperating  failure 
rates  were  attributable  to  special  components  for  which  no  failure  rate  models 
exist  in  MIL-HD  BK-2  1 7  B ;  hence,  these  parts  limited  the  degree  of  failure 
rate  reduction  possible  at  the  nonoperating  (zero  stress)  level. 

To  examine  this  point  in  more  detail,  an  assessment  of  the  contribu¬ 
tion  of  non-217B  parts  was  prepared  for  each  of  the  six  equipments  studied. 


The  effect  of  the  non-217B  parts  was  assessed  in  terms  of  relative  parts 
quantity  and  also  the  percentage  of  the  total  failure  rate  for  comparison  with 
the  predicted  ratios  of  operating  to  nonoperating  failure  rates.  The  impact 
of  these  non-standard  parts  on  the  resultant  nonoperating  failure  rate  pre¬ 
dictions  is  given  in  Table  4-2.  It  is  evident  that  in  the  case  of  equipments 
O'  through  Go,  the  non-217B  parts  failure  rate  contribution  to  the  total  non¬ 
operating  failure  rates  completely  dominates  the  resultant  predicted  values. 


TABLE  4-2.  PARTS  FAILURE  RATE  SUMMARY 


Equipment 

Number 

Percent 

Non-2  1  7B  Part  s 
Count 

Percent  \NOP 
Contribution 

Ratio 

AOP  /\NOP 

Std  -2  1  7B 

01 

1.9 

88.4 

11.6 

2.83 

02 

2 ,  S 

84.8 

15.2 

2.21 

03 

>  ~ 
w  •  1 

38.3 

61.1 

5.72 

04 

2.3 

32 . 3 

t?7.  1 

1.4Q 

05 

0.^ 

40.3 

53.  l 

3.44 

Go 

o .  8 

42.3 

5  7.1 

1.53 

Alternatively,  if  one  were  to  establish  a  judgmental  factor  with  which 
to  treat  the  non-21?B  parts  failure  rates  in  the  absence  of  actual  data,  the 
results  would  most  likely  be  equally  suspect.  For  these  reasons,  and  the 
previously  stated  disclaimer  in  MIL -H  D  BK- 2  1  7  B  regarding  predictions  based 
on  extrapolation  to  the  zero  stress  levels,  these  predicted  nonoperating 
failure  rates  must  be  viewed  with  caution. 
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4.  1.4  Predicted  Nonoperating  Failure  Rates 


Two  additional  methods  for  predicting  nonoperating  failure  rates 
from  available  data  were  investigated.  These  were  based  on  prediction 
methods  described  in  RADC-TR-73-248  and  U.  S.  -my  MIRADCOM 
Report  LC-78-1  (References  34  and  36,  respectively-.  The  first  method, 
which  was  developed  by  Martin-Marietta  under  contract  to  RADC  is 
described  in  the  report  "Dormancy  and  Power  On-Off  Cycling  Effects  on 
Electronic  Equipment  and  Parts  dated  August  1973.  It  is  important  to 
note  that  the  dormant  failure  rates  contained  in  this  report  have  the 
following  characteristics: 

1.  The  dormant  failure  rate  for  microelectronic  devices  did  not 
account  for  complexity  of  the  devices. 

2.  In  general,  the  report  only  provides  dormant  failure  rates  for 
various  component  groups.  As  an  example,  for  MIL-STD 
capacitors,  only  three  groups  of  dormant  failure  rates  were 
provided. 

The  second  prediction  method  was  based  on  component  nonoperating 
failure  rates  listed  in  the  U.  S.  Army  Missile  Research  and  Development 
Command's  Report  LC-78-1,  entitled  "Missile  Material  Reliability  Pre¬ 
diction  Handbook  -  Parts  Count  Prediction,  ”  dated  February  1  978.  This 
report  provides  more  detailed  nonoperating  failure  rate  information.  For 
example,  for  MIL-STD  capacitors,  the  best  estimated  nonoperating  failure 
rates  of  21  different  type  capacitors,  were  provided.  In  addition  to  the  best 
estimate  nonoperating  failure  rate  of  each  type,  a  90  percent  upper  confi¬ 
dence  limit  was  also  presented.  For  the  second  set  of  predictions  the  best 
estimated  value  of  each  nonoperating  failure  rate  was  used.  To  facilitate 
subsequent  reference  to  these  two  methods,  they  will  be  referred  to  as  the 
RADC  method  and  MIRADCOM  method,  respectively. 

A  review  of  the  sis  individual  prediction  analyses  indicated  that  the 
dominant  contributors  to  the  nonoperating  failure  rate  characteristics  of  the 
equipments  did  not  follow  any  consistent  pattern.  In  some  cases  the  principal 
contributors  were  low  population  devices  such  as  switches,  thermal  resistors, 
connector  panels,  filters,  lamps,  etc.  ,  whereas  in  other  case  they  were  the 
high  population  devices  such  as  resistors,  capacitors,  IC  s ,  etc.  ,  or  some 
combination  of  the  two  categories  indicated. 
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The  results  of  these  two  methods  yielded  the  values  given  in  Table  4-3 
of  nonoperating  failure  rates  for  each  of  the  six  equipments  included  in  the 
study.  To  facilitate  comparisons,  the  average  measured  nonoperating  failure 
rates  derived  from  the  data  in  Table  3-7  have  also  been  included  in  Table  4-3. 
Measured  average  nonoperating  failure  rates  were  derived  from  the  individual 
equipment  values  given  in  the  column  labelled  LAMNOP  of  Table  3-7 
(page  3-30’i. 

TABLE  4-3.  PREDICTED  AND  MEASURED  NONOPERATING 
FAILURE  RATES  (IN  FAILURES  PER  MILLION  HOURS) 


Equipment 
Numbe  r 

Predicted  Nonoperating  Failure  Ratec 

Measured 
Nonoperating 
Failure  Rates 

per  RADC-TR-73-248 

per  MIRADCOM  LC-78-1 

01 

86.  1 

29.  2 

7.4 

02 

cl  .  8 

35.  7 

18.  3 

03 

589.  7 

118.8 

61.7 

04 

26.  6 

10.  3 

35.  3 

05 

101.0 

37.  3 

28.  4 

Oo 

_ 

qo  7 

31  .  o 

11.3 

Note  that  in  the  case  of  equipments  01  and  03  the  average  measured 
nonoperating  failure  rates  are  based  on  the  censored  data  set  on  which  the 
final  analysis  results  were  based.  The  equipment  applications  censored 
were  those  having  an  annual  average  of  100  or  less  installed  equipments. 
The  difference  in  the  measured  values  of  nonoperating  failure  rates  with  or 
w  ithout  censoring  is  negligible  (i.  e.  :  7.  5  and  19.  7  for  equipments  01  and  02 
respectively).  Since  comparisons  are  subsequently  made  between  results 
obtained  using  different  analysis  methods,  all  analysis  results  given  in  this 
report  are  based  on  the  censored  data  set  to  maintain  a  consistent  basis 
of  comparison. 


1 

j 

4.1.5  Comparison  of  Predicted  and  Measured  Nonoperating  Failure  Rates 

To  provide  a  comparison  of  the  results  of  the  three  different  non¬ 
operating  failure  rate  prediction  methods  used,  the  ratios  of  the  predicted 
to  measured  nonoperating  failure  rates  were  calculated.  This  was  done  for 
each  of  the  six  equipments  based  on  the  average  failure  rate  values  for  each 
equipment  based  on  the  measured  nonoperating  failure  ra^es  given  in  Table  3-7 
in  the  column  headed  LAMNOP.  The  results  are  presented  in  Table  4-4. 


TABLE  4-4.  PREDICTED  TO  MEASURED  p  RATIOS 


Predicted  to  Measured  X.,-,-  Ratio 

NOP 

Equipment 

Number 

MIL-HDBK  -21  7B 
Zero  Stress 

RADC 

TR-73-248 

MIRADCOM 

LC  -78-1 

01 

39.  2 

11.5 

2.  8 

02 

6.  6 

3.  1 

1 .  2 

03 

12.  0 

9.  6 

0.  9 

04 

7.2 

0.  8 

0.  3 

05 

18.  1 

3.  6 

1 .  2 

06 

9.  4 

00 

00 

2.  7 

Although  the  comparison  indicates  that  the  MIRADCOM  prediction 
method  gave  the  best  results,  an  examination  of  the  ratios  for  each  of  the 
six  equipments  using  this  method  indicates  an  unacceptably  large  variation 
among  the  six  equipment  items-  Because  of  concern  over  the  reasons  for 
the  variation,  a  subsequent  investigation  of  other  possible  causal  factors 
related  to  the  maintenance  data  is  included  in  Section  4.  6  of  this  report. 

A  subsequent  set  of  regression  analyses  was  performed  to  evaluate 
the  three  methods  of  nonoperating  failure  rate  prediction;  the  results  are 
presented  in  Section  4.4.2  through  4.4.5  of  this  report. 


4.  2  COMPOSITE  FIELD  PERFORMANCE  ASSESSMENTS 


This  section  of  the  report  deals  with  the  analyses  performed  to  derive 
the  desired  field  performance  characteristics  of  the  26  equipment/aircraft 
applications  included  in  the  study  and  the  composite  average  values  of  the  para¬ 
meters  of  interest  for  each  of  the  six  equipment  types.  The  composite  para¬ 
meters  evaluated  consisted  of  the  failure  rate  characteristics,  the  improve¬ 
ment  factors  resulting  from  the  elimination  of  nonoperating  failures  from 
operational  MTBF  assessments,  and  the  environmental  severity  factors  and 
age  factors  required  for  subsequent  regression  analysis  tasks. 


4.  2.  1  Composite  MTBF  Assessments 

The  composite  values  of  the  measured  MTBF  characteristics  for 
each  of  the  six  equipment  types  were  calculated  using  the  failure  rate  data  for 
the  three  indices  of  interest  (total,  operating  ar.i  nonoperating  failure  rate) 
listed  in  the  columns  headed  LAMTOT,  LAMOP,  and  LAMNOP  respectively 
listed  in  Table  3-7. 

The  composite  MTBF  values  were  then  derived  using  the  expression 
Composite  MTBF  =  ( \)  * 


where 


IT 

^\XOT 


ktot  =  -1- 


and  in  a  similar  manner,  the  values  of  the  operating  and  nonoperating  failure 
rates  were  obtained. 


The  results  of  these  calculations  for  the  six  equipments  and  the 
predicted  values  derived  in  the  preceding  section  were  then  reviewed  and  com¬ 
pared  and  figures  of  merit  comparing  the  predicted  MTBFs  to  the  measured 
MTBFs  were  calculated.  The  results  are  given  in  Table  4-5.  Note  that  one 
additional  factor  has  been  included  for  comparison  purposes,  labelled  Measured 
Inherent  MTBF.  This  factor  is  an  independently  derived  value  of  measured 
MTBF  resulting  from  independent  contractor  assessments  performed  under 
BIW  (Reliability  Improvement  Warranty)  contracts  on  Equipment  01  and  06. 


These  indices  (inherent  MTBF)  use  assessment  criteria  that  are  more  con¬ 
sistent  with  the  criteria  used  for  predictions  of  MTBF  per  MIL- J-iDBK- 21  7B. 
As  can  be  seen,  the  figures  of  merit,  ratio  of  predicted  MTBF  to  inherent 
MTBF  are  considerably  improved  over  those  based  on  assessments  using 
field  maintenance  data  and  HQ  AFLC  assessment  criteria. 


Table  4-5.  Composite  MTBF  Assessment  Data 


Eq. 

No. 

Ba  ^  e  lin  e 
Predicted 
MTBF 

Measured 

Total 

MTBF" 

Measured 

Operating 

MTBF- 

Measured 

Inherent 

MTBF 

Predicted  7Field  MTBF 
Discrepancy  Factor 

P/TOT 

P/OP 

P.  INH 

t - 

01 

1  205 

748.  3 

2024 

1.  73 

ni 

0.  59 

02 

3457 

398.  7 

N  'A 

9.  70 

HI 

N  A 

03 

23t> 

161 . 0 

N  A 

1.7c 

1.47 

X  A 

04 

2c  3  3 

45o.  5 

o92.  1 

N  A 

5.  77 

3.  80 

X  A 

05 

2732 

5o9.  2 

764.  5 

N  A 

4.  80 

3.  48 

X,  A 

0  D 

1274 

442.  0 

475.  8 

880 

2.  88 

2.  68 

1.45 

"  Based  on  Average  of  Failure  Kates 


4.  2.  2  Composite  Failure  Rate  Assessments 

The  composite  values  of  the  measured  failure  characteristics  for 
each  of  the  six  equipments  were  calculated  using  failure  data  for  the  three 
indices  of  interest  (total  failures,  operating  failures,  and  nonoperating 
failures)  listed  in  the  columns  headed  FT OT ,  FOP,  and  FNOP  respectively 
in  Table  3-7.  An  additional  factor  of  interest,  the  ratio  of  the  composite 
operating  to  nonoperating  failure  rates,  which  is  used  in  subsequent  analysis 
tasks  was  also  calculated  and  is  included  in  Table  4-6.  Note  that  in  each 
case  the  values  given  for  equipments  01  and  02  represent  the  censored  data 
set  for  each  of  the  indicated  parameters.  This  was  done  to  facilitate  the 
comparisons  made  in  the  subsequent  analyses,  which  are  based  on  the 
censored  data  set  as  explained  in  the  section  that  follows. 
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TABLE  4-6.  COMPOSITE  FAILURE  CHARACTERISTICS  DATA 


Fq. 

Mo. 

Average 

Number  of  Failures 

Average  Failure  Rate" 

LQP, 

Xxop 

Ratio 

FTOI 

FOP 

FN’OP 

XTOT 

I  XOP 

1.XOP 

01 

233.  4 

214.  o 

18.  5 

1  545 

7.  4 

188.  4 

02 

olS.  0 

552.  0 

272b 

18.  3 

131.  8 

0  3 

454.  5 

379.  0 

77.  5 

7547 

61.  7 

100.  7 

04 

524.  5 

344.  5 

180.  0 

2191 

n 

35.  3 

40.  9 

2oo.  0 

194.  0 

72.  0 

1757 

1275 

28.  4 

44.  9 

o77.  0 

o35.  0 

42.  0 

2262 

2102 

11.3 

1  8o.  0 

"Failure  Rate  is  in  failures  per  million  hours  (F  mh). 

i _ 


4.2.3  Environmental  Severity  Factor  Calculations 

To  provide  a  means  for  combining  the  data  representing  a  given 
equipment  type  used  on  both  bomber  transport  and  fighter  interceptor  type 
aircraft,  a  means  of  normalizing  the  failure  data  to  a  common  environmental 
severity  factor  was  required.  This  was  done  by  defining  the  environmental 
severity  factor  as  the  ratio  of  the  average  failure  rate  on  fighter  intercepter 
applications  to  the  average  on  bomber/transport  applications  for  the  ARX-113 
TACAN  and  the  ARC-lc4  UHF  Radio.  These  factors  were  calculated  and 
the  resultant  values  derived  as  follows: 


Eq.  01  ESF 


^TOTFOl 

TfoiBoT  * 


1 72 o . 0  5 
1  3 o 3 .  73 


1 . 2o  5  7 


QTF02 


Es-  02  ESF  =  Ttotbo! 


30  70,  87 
2037.  o  3 


1.  5071 


4.2.4  Average  Age  Factor  Calculations 

Since  the  equipments  selected  for  special  studies  were  of  different 
population  age  characteristics  on  the  various  aircraft  applications,  a  means 
of  establishing  the  age  factor  (i.  e.  ;  the  ratio  of  the  equipment's  average  age 


J 


on  a  given  aircraft  type  to  the  average  age  of  all  applications  using  the  same 
equipment)  was  devised.  This  was  accomplished  by  reviewing  the  installa¬ 
tion  data  for  each  equipment  application  of  interest  and  compiling  the  annual 
average  age  values  from  the  installation  data  provided  by  AFLC. 

The  method  of  calculation  was  as  follows: 


Annual  Average  Age 


AGEHRS 


n 


where  n  =  number  of  aircraft  type  applications. 


Based  on  the  data  from  Table  3-7,  Column  AGEHRS,  the  average 
age  factor  values  for  equipments  01  and  02  were  calculated  as  follows: 


Eq.  01  Average 
Eq.  02  Average 


3925 

8 

6518 

9 


490.63 

724.22 
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The  nonoperating  failure  rates  were  assessed  for  each  of  the  26 
equipment/aircraft  applications  included  in  the  study  and  ratios  of  the  oper¬ 
ating  to  nonoperating  failure  rates  plotted  on  a  nomograph  to  provide  a 
graphical  presentation  of  how  this  characteristic  varies  with  the  equipment 
utilization  rate. 

In  addition,  several  plots  were  prepared  to  present  a  graphical 
picture  of  the  distribution  of  nonoperating  failures  in  terms  of  population 
distribution,  improvement  factor  distributions,  and  the  distribution  within 
each  equipment  type.  These  plots  appear  in  Figures  4-2  through  4-5 
respectively. 

Examining  the  data  points  of  Figure  4-2,  it  appears  that  there  is 
considerably  more  scatter  to  the  data  than  what  one  would  expect  if  the  failure 
rate  ratio  (XOP/A.NOP)  for  a  given  equipment  was  primarily  an  intrinsic 
characteristic  of  the  equipment.  This  suggests  that  perhaps  other  factors 
are  influencing  the  data  used  for  the  assessment,  thereby  causing  the  wide 
range  of  variations  observed.  Since  the  study  was  limited  to  the  use  of 
available  data,  this  phenomenon  could  not  be  investigated  further;  however 
there  are  several  possible  causes  that  appear  to  be  responsible,  based  on 
detailed  inquires  and  discussions  held  with  field  maintence  and  logistics 
specialists  on  this  subject.  These  are  discussed  separately  in  Section  4.6 
of  this  report  along  with  several  related  observations  on  the  use  of  field 
maintenance  data  for  reliability  assessment  purposes. 


4.  3.  2  Impact  of  Nonoperating  Failures  on  MTBF  Assessment 

The  degree  to  which  the  assessed  operational  MTBF  is  improved  by 
excluding  nonoperating  failures  from  the  total  failures  counted  was  evaluated 
for  each  of  the  26  equipment/aircraft  applications  and  also  for  the  composite 
value  of  each  of  the  six  equipment  types.  The  calculation  method  utilized 
•was  as  follows; 


Improvement  Factor 


MTBFOP 

MTBFtot 


XTOT 

*OP 
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Composite  Improvement  Factor  = 


^TOT 
kOP 

using  the  data  for  the  items  of  interest  given  in  Table  3-7  in  the  columns 
headed  LAMTOT  and  LAMOP  for  the  values  of  the  respective  total  and  oper¬ 
ating  failure  rates. 

The  results  of  the  calculation  of  the  improvement  factors  and  the 
related  average  values  are  given  in  Table  4-7  and  are  plotted  in  Figures  4-3 
through  4-5.  Figure  4-3  is  a  plot  in  which  the  values  of  each  of  the  applica¬ 
tions'  26  improvement  factors  have  been  ordered  in  5°;  increments  so  that  a 
population  distribution  of  the  improvement  factors  (expressed  in  percentile 
increments)  is  obtained. 


Table  4-7.  Composite  MTBF  Improvement  Factors  Data 


Eq. 

No, 

Nonoperating 
Failure  Hate 
( F/mh) 

XNOP 

Ratio 

Pe  rc  ent 
Nonoperating 
Failures 

Avg.  MTBF 
Improvement 
Facto  r 

Min.  MTBF 
Improvement 
Factor 

Max.  MTBF 
Improvement 
Factor 

01 

7.4 

188.4 

7.9 

1.08b 

1.0  56 

1.144 

02 

18.  3 

131.8 

10.  8 

1.  120 

1. 038 

1.  322 

03 

01.7 

100.  7 

1  o.  6 

1.  199 

1.  197 

1. 203 

04 

38.  3 

40.9 

34.  3 

1.  522 

1. 490 

1 .  537 

05 

28.  4 

44.  9 

27.  1 

1.  371 

1.  371 

1.  371 

Go 

11.3 

18o.  0 

6.  2 

1  .  Obb 

1 . 06b 

1.  Obb 

Avg. 

— 

— 

17.  2 

1. 277 

— 

— 

Figure  4-4  indicates  the  composite  results  for  each  equipment  and 
shows  a  range  of  improvement  factors  varying  almost  10  to  1  among  the  six 
composite  values.  Figure  4-5  also  includes  an  additional  factor  of  interest, 
namely  the  range  over  which  this  factor  varies  within  a  given  equipment.  As 
can  be  seen,  Equipment  02  (  UHF  Radio)  which  is  represented  by  11  different 
applications  has  an  improvement  factor  of  1.038  on  the  low  end  of  its  range 
to  1.  322  on  the  high  end. 
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4.4  GENERAL  REGRESSION  ANALYSIS 

Multiple  regression  analysis  is  a  useful  statistical  technique  to  account 
for  the  functional  relationship  between  factors  or  variables  under  study.  This 
can  be  accomplished  by  considering  the  joint  variation  of  the  variables  from 
empirical  or  experimental  data. 

In  a  multiple  regression  analysis,  for  example,  the  degree  of  corre¬ 
lation  between  random  variables  can  be  measured  by  the  coefficient  of  cor¬ 
relation  (or  its  square  —  index  of  determination)  which  has  possible  a  range 
of  values  from  0  to  ±1.  A  correlation  between  one  or  more  random  variables 
is  nonexistent  when  the  coefficient  of  correlation  is  zero  and  there  is  perfect 
correlation  when  the  coefficient  of  correlation  is  1;  the  regression  equation 
provides  a  means  for  predicting  the  best  estimate  of  a  dependent  variable 
when  the  values  of  the  independent  variables  are  given. 

For  this  analysis,  a  computer  program  based  on  a  stepwise  regres¬ 
sion  analysis  procedure  was  used.  The  program  computes  a  sequence  of 
multiple  linear  regression  equations  in  a  stepwise  manner.  At  each  step, 
one  variable  is  added  to  the  regression  equation.  The  variable  added  is 
the  one  that  makes  the  greatest  reduction  in  the  error  sum  of  squares.  It 
is  the  variable  that  has  the  highest  partial  correlation  with  the  dependent 
variable  (operating  or  nonoperating  failure  rates);  i.e.  ,  this  variable  has  the 
most  significant  effect  on  the  dependent  variable.  On  the  other  hand,  the  less 
significant  variables  will  be  automatically  removed  in  accordance  with  a  given 
level  of  significance. 

A  multiple  regression  analysis  was  performed  using  the  following 
factors; 

1.  Nonoperating  MTBF  as  dependent  variable 

2.  Percent  nonoperating  failures 

3.  Ratio  of  operating  to  nonoperating  failure  rate 

4.  Maintenance  index  (MI) 

5.  Equipment  utilization  rate 

fc.  Percent  operating  time 

7.  Failures  per  sortie 

8.  Mission  duration 
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9.  Total  maintenance  actions 

10.  Removals  per  equipment 

11.  Removals  per  flight  hour 

12.  Failures  per  equipment  per  year 

13.  Average  equipment  age  in  operating  hours 

14.  Flight  hours  per  equipment. 

Six  sets  of  data  representing  selected  combinations  of  equipments 


01  and  02  and  aircraft  application  were  analyzed  and  are  listed  in  Table  4-8. 
TABLE  4-8.  MULTIPLE  REGRESSION  ANALYSIS  DATA  SETS 


Set 

Equipment /Application 

I. 

Equipment  No.  01  Bomber/Transport 

4  points 

II. 

Equipment  No.  02  Bomber/Transport 

a  points 

III. 

Equipment  No.  01  Fighter /Interceptor 

5  points 

IV. 

Equipment  No.  02  Fighter/Interceptor 

7  points 

V. 

I  and  III  Combined 

9  points 

VI. 

II  and  IV  Combined 

1 1  points 

The  analyses  were  concentrated  on  equipments  01  and  02  because 
these  two  equipment  types  provided  the  largest  number  of  data  points  and 
would  most  likely  provide  useful  results  for  the  development  of  predictive 
models.  The  remaining  four  equipments  (03  through  06  respectively)  could 
not  be  used  for  model  development  since  each  of  these  equipment  types  were 
only  operational  on  one  or  two  aircraft  applications. 

The  general  regression  analysis  results  indicated  thkt  two  of  the 
factors,  namely  mission  duration  and  percent  operating  time  appeared  to  be 
significant  in  influencing  field  failure  rates.  This  confirms  simular  findings 
in  a  previous  study  (Reference  6)  on  operational  influences  on  avionic 
equipment  reliability.  The  correlation  coefficents  of  these  two  factors 
relative  to  measured  failure  characteristics  (i.  e.  :  failures  per  sortie  and 
failures  per  equipment  per  year)  are  given  in  Table  4-9.  Note  that  the  cor¬ 
relation  coefficients  of  both  factors  for  four  of  the  six  data  sets  evaluated  are 
greater  than  0.  8. 


TABLE  4-9.  SUMMARY  OF  CORRELATION  COEFFICIENTS 
OF  IMPORTANT  FACTORS 


Dependent 

Variables 

Independent  Variables 

Mission  Duration 

Percent  Operating  Time 

Sets 

Set  s 

1 

D 

■ 

n 

V 

VI 

F ailure s  / 

Sort  le 

Failure  s  / 
Equipment 

0.686 

0.859 

0.806 

0.  32  5 

0.892 

0.884 

0.885 

_ 

0.834 

~  . . . 

0.597 

1  "1 

o.eoi 

0.  792 

0.5  15 

No .  of  data  pt  s 

4 

a 

5 

i 

9 

1) 

n 

n 

L_J 

D 

9 

D 

Specially  selected  analyses  based  on  these  factors  for  data  sets  V 
and  VI  are  described  in  Section  4.5.  Although  the  coefficients  of  correlation 
for  these  two  sets  were  not  the  highest  shown  in  Table  4-9,  these  sets  were 
selected  for  analysis  because  1)  they  have  the  largest  number  of  data  points 
(9  and  11,  respectively)  and  2)  with  normalization  for  age  and  environment 
they  provided  the  best  overall  results  as  inoicated  by  both  the  index  of  deter¬ 
mination  and  the  consistence  with  observed  trends. 

4.4.  1  Evaluation  of  Failure  Rate  Predictors 

In  Sections  4.4.2  through  4.4.8  the  measured  failure  rates  based  on 
the  26  data  points  for  the  six  equipment  types  and  the  ratios  of  failure  rates 
are  compared  to: 

1.  Failure  rate  predictions  based  on  MIL -HDBK -2  1 7B 

2.  Nonoperating  failure  rate  predictions  based  on  the  RADC  method 

3.  Nonoperating  failure  rate  predictions  based  on  the  MIRADCOM 
method 

4.  The  total  number  of  electronic  parts 

5.  The  number  of  microelectronic  parts  (ICs  and  Hybrids),  and 

6.  The  ratio  of  microelectronic  parts  to  total  electronic  parts. 
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The  data  used  for  these  analyses  are  listed  in  Table  4-10  from  which 
the  following  lt>  sets  of  simple  regression  analyses  were  performed: 


8 

o 

1  0 

1  1 

Id. 

1  3. 

14. 

1  4. 

1  D. 


Measured  ^Qp  versus  predicted  ^Qp  (MIL-H DBK -21  7B  method) 

Measured  ^Qp  versus  predicted  ^Qp  (dl7B  zero  stress  method) 

Measured  \^Qp  versus  predicted  ^^Qp  (RADC  method) 

Measured  \^-Qp  versus  predicted  \j,qP  (M1RADCOM  method) 

Measured  \^p  versus  number  of  microelectronic  parts 

Measured  \-yQp  versus  number  of  microelectronic  parts 

Measured  \^p  versus  total  number  of  electronic  parts 

Measured  \^-Qp  versus  total  number  of  electronic  parts 

Measured  V_0  versus  ratio  of  niic  roelectronic  to  total  electronic 
pa  rt  s 

Measured  \^.^p  versus  ratio  of  microelectronic  to  total 
electronic  parts 

Ratio  of  measured  \_...,  to  versus  number  of  microelec - 

,  .  Or  A  OP 

tromc  parts 

Ratio  of  measured  \^  ,  to  \^.^p  versus  total  electronic  parts 

Ratio  of  measured  to  X^-Qp  versus  ratio  of  microelectronic 

total  electronic  parts 

Ratio  of  ^Qp  to  X^.^p  versus  measured  \^, 

Ratio  of  measured  X^j,  to  X^.^,  versus  measured  ^^-Qp 

Ratio  of  measured  to  X.,,..,,  versus  ratio  of  predicted  X,,., 

,  .  OP  NOP  r  OP 

''NOP  ’ 
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POP  1PM E  N  I  FIELD  FAILURE  RATE  AND 
PARTS  MIX  DATA 


Equipment 

Number 

Field  Measurec 

Values 

Number  of 
Mic  ro- 
elect  ronic 
Pa  rt  s 

Total 

Number  of 
Electronic 
Pa  rt  s 

Micro¬ 
electronic 
Pa  rt  s , 

Pe  rcent 

XOP 

XN'0P 

mm 

I 

01 

1  3  3o 

7 .  ^ 

177.7 

4  3o 

2870 

Id.  4 

02 

2  4 OS 

DP  7 

127.  7 

1  1 

1  d3d 

4.7 

0  3 

t-2  1  1 

t-*  1  .  7 

1  00.  7 

4  So 

8071 

D.  0 

11.3 


P 

1  3sp 
201 


The  niethod  of  analysis  used  was  a  least  squares  fit  program  called 
CL'RVFIT.  The  CURYFIT  program  is  designed  to  compare  plotted  data  points 
on  X-Y  axes  with  various  algebraic  and  exponential  functions  using  a  least 
squares  fit  to  determine  a  curve  and  mathematical  expression  for  that  curve 
which  best  fits  the  plotted  points.  In  addition,  the  CURYFIT  program  calcu¬ 
lates  the  index  of  determination  (coefficient  of  correlation  squared)  for  each 
of  the  six  standard  curves  against  which  the  input  data  are  fitted.  The  output 
of  the  analysis  resulting  from  each  data  set  analyzed  is  displayed  in  tabular 
form  indicating  the  index  of  determination  and  values  of  the  constants  A  and  B 
tor  each  of  the  six  standard  equations.  This  program  was  used  to  evaluate 
the  relationships  discussed  in  the  remainder  of  this  section.  An  example  of 
the  output  format,  from  which  the  best  curve  fitted  is  selected  is  included  in 
the  discussion  of  the  first  set  evaluated,  namely  the  r elationship  between  the 
predicted  and  measured  operating  failure  rates  of  the  six  equipments  studied. 

Of  the  lo  roe, res s ion  analvses  performed,  oniv  seven  were  tound  to  be 
s  tatis  tic  a  11  v  significant  or  of  special  interest.  These  seven  detailed  analyses 
are  described  in  pa.  ragraphs  4.  4.-1  through  4.4.0  o:  this  section. 

4  .  4  .  d  Predicted  versus  leasured  Operating  i  allure  Rates  Based  on 
MIL-HDBK-d  1  ~B 

The  regression  analvsis  result  shows  that  the  index  of  determination 
between  predicted  and  measured  operating  failure  rates  is  O.^d. 

The  regression  equation,  is: 


Y  -  “ .  o  •  0.  "'iX' 


whe re : 

X  -  measured  operating  failure  rate 
Y  -  predicted  operating  failure  rate. 

The  regression  equation  is  plotted  m  Figure  4-t'. 

The  results  suggest  that  there  is  a  reasonable  gooc:  correlation  betweer 
the  oreriieted  and  measured  operating  tailure  rates.  However,  the  regression 
line,  which  is  plotted  Figure  4  t> ,  is  wholly  controlled  bv  idqu.pment  dV 
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Table  4- Li.  Regression  Analysis  Results  -  MIL-HDBK-217B 
Predicted  versus  Measured  Operating  Failure  Rates 


LEAST  SUUARES  CURVES  FIT 


CURVE  TYPE 


1.  Y=A*(6*X) 

2.  r=A»ExP(d*x) 

3.  YSA.CX-B) 

4.  r=A*(B/X) 

5.  Y=1/(A+B*X) 

6.  Y=X/(A*ri*X) 


INDEX  UF 
DETEWMlNA  T ION 

A 

.915238 

.73424a 

.628781 

.606411 

•  36b5 1 
,2205b 

-775.567 
228.526 
2.83908E-O2  j 
3884.35 
2.91004t-03 
2.41266  | 

_ L 

.777079 

a. ae32^e-04 

1 .3222 

-5  .  ObbbbE  +  Ofe 
-3. 98728E-07 

b. 2003lE-04 


Without  the  Equipment  03  point  the  best-fit  curve  would  show  an  inverse 
relationship  between  the  measured  and  predicted  failure  rates.  This 
indicates  that  the  unpredictable  factors  are  so  large  that  for  the  group  of 
equipments  without  Equipment  03,  the  variation  in  equipment  complexity 
is  not  sufficient  for  performing  a  correlation  analysis  of  predicted  versus 
measured  failure  rates.  Alternatively,  it  is  also  apparent  from  a  review 
of  the  measured  failure  rates  that  the  maintenance  data  records  from  which 
the  measured  failure  rates  are  derived  are  subject  to  considerable  variation 
because  of  factors  such  as  differences  in  maintenance  and  documention 
practices,  data  quality,  etc. 

4.4.3  Predicted  versus  Measured  Nonoperatine  Failure  Rates  Based  on 

MIL-HDBK-2  1  7B 

Through  the  simple  regression  analysis,  the  index  of  determination 
between  predicted  and  measured  nonoperating  failure  rate  is  0.28. 

The  regression  equation  is: 

Y  =  1  64.  4  -  6.  503(X) 

Where: 

X  =  measured  nonoperating  failure  rate 

Y  =  predicted  nonoperating  failure  rate. 

The  regression  equation  is  plotted  as  shown  in  Figure  4-7. 

The  predicted  nonoperating  failure  rates  were  based  on  the  parts 
zero  stress  failure  rates  from  MIL- HDBK- 2  1  7B .  It  is  realized  that  the 
handbook  rates  are  not  to  be  used  for  calculating  nonoperating  failure  rates. 
They  were  caL  ated  for  the  purpose  of  examining  possible  correlations  only. 
A  closer  examination  revealed  that  a  rather  1'  ge  part  of  the  failure  rates 
was  attributed  to  parts  for  which  no  failure  r.  models  exist  in  MIL-HDEK- 
217B.  These  parts  failure  rates  remained  the  same  for  both  operating  and 
nonoperating  conditions  and  in  effect  dominated  the  nonoperating  failure  rates 
of  the  equipments.  Therefore,  the  predicted  nonoperating  failure  rates 
should  not  be  considered  representative  of  MIL-HDBK- 2 1  7B  zero  stress  rates. 


Through  regression  analysis,  the  following  results  were  determined 
for  predicted  versus  measured  nonoperating  failure  rates  based  on  the  pre¬ 
diction  analysis  results  using  the  method  given  in  RADC-TR-73-248. 

Tiit-  index  of  determination  between  the  predicted  and  measured  non¬ 
operating  failure  rates  is  0.65. 

The  regression  equation  is: 

Y  =  -7  1.2  4  8.  569(X) 

where : 

X  =  measured  nonoperating  failure  rate 

Y  =  predicted  nonoperating  failure  rate  (based  on  RADC  method). 


•  "  1  !VW  ' 


The  regression  equation  and  corresponding  data  points  are  plotted  in 
Figure  4-8.  However,  it  should  be  noted  that  the  equation  is  heavily  depend¬ 
ent  on  the  data  point  representing  equipment  03.  Therefore,  although  the 
results  appear  to  be  statistically  significant,  caution  should  be  taken  when 
using  this  equation,  which,  if  omitted  would  result  in  a  negative  relationship 
between  measured  versus  predicted  nonoperating  failure  rates. 


Figure  4-8.  Predicted  versus  measured  nonoperating  failure  rates 
(RADC  method). 


4.4.5  Predicted  versus  Measured  Nonoperating  Failure  Rates  Based  on 

MIRAPCQM  Method 

Following  the  same  approach  to  analysis  of  the  data  (Table  4-2) 
resulting  from  the  nonoperating  failure  rate  predictions  using  the  MLRADCOM 
LC-78-1  method  (Raytheon  report),  the  following  regression  analysis  results 
were  obtained. 

The  index  of  determination  between  the  predicted  and  measured 
nonoperating  failure  rates  is  0.  57. 
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The  regression  equation  is: 


Y  =  4.  8  +  1.  443(X) 


whe  re : 

X  =  measured  nonoperating  failure  rate 

Y  =  predicted  nonoperating  failure  rate  (based  on  MIRADCOM  method) 

The  regression  equation  and  corresponding  data  points  are  plotted  in 
Figure  4-9.  Again,  as  in  the  preceding  case,  it  is  apparent  that  without  the 
data  point  representing  equipment  03,  the  results  would  be  radically 
diffe  r ent . 


Figure  4-9.  Predicted  versus  measured  nonoperating  failure  rates 
(MIRADCOM  method). 


4.4.6  Measured  Operating  Failure  Rate  versus  Total  Number  of 
Electronic  Parts  ~ 

The  index  of  determination  between  the  measured  operating  failure 
rate  and  the  total  number  of  electronic  parts  is  0.68. 

The  regression  equation  is: 

Y  =  -55.  4  +  1.  22(X) 


where 

Y  =  observed  operating  failure  rate 

X  =  total  number  of  electronic  parts. 

The  regression  equation  is  plotted  in  Figure  4-10 

The  measured  operating  failure  rates  appear  to  have  a  positive 
correlation  with  the  total  number  of  electronic  parts.  However,  since  the 
line  is  greatly  dependent  on  Equipment  03,  the  determination  of  the  magni¬ 
tude  of  the  slope  would  require  further  analysis  using  additional  equipment 
points  in  the  3000  to  8000  parts  region. 


Figure  4-10.  Measured  operating  failure  rates  versus 
total  number  of  electronic  parts. 
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4.4.7  Ratio  of  the  Measured  Operating  Failure  Rate  to  Nonoperatinj 


1  aiiure  Kate  versus  the  Number  ol 


The  index  of  determination  is  0.  12. 
The  regression  equation  is 


ncroelectromc  Karts 


Y  =  131. 8  -  0.  044(X) 


where : 


Y  =  ratio  of  measured  operating  failure  rate  to  nonoperating  failure 
rate 

X  =  the  number  of  microelectronic  parts. 

The  regression  equation  is  plotted  in  Figure  4-11. 

The  ratios  of  measured  operating  to  nonoperating  failure  rates 
appear  to  have  a  negative  correlation  with  the  number  of  microelectronic 
devices  used  in  an  item  of  equipment. 


The  index  of  determination  is  0.  0005. 
The  regression  equation  is: 


Y  =  111.4+0.  109(X) 


where: 

Y  =  the  ratio  of  measured  operating  to  nonoperating  failure  rate 

X  =  the  percentage  of  microelectronic  parts 

The  regression  equation  is  plotted  in  Figure  4-12. 

The  regression  results  did  not  confirm  the  commonly  held  belief  that 
the  ratio  of  operating  to  nonoperating  failure  rate  decreases  as  the  percentage 
of  microelectronic  parts  is  increased.  On  the  contrary,  the  analysis  results 
suggest  that  there  is  no  significant  relationship  between  the  two  factors. 


Figure  4-12.  Ratio  of  measured  operating  to  nonoperating  failure 
rate  versus  percentage  of  microelectronic  parts. 


i 

Other  variables  to  consider  are  the  inconsistencies  in  the  criteria  used 
for  the  determination  of  relative  parts  count  and  complexity  factors,  and/or 
the  inclusion  of  special  part  failure  rates  for  those  parts  not  included  in 
MIL-HDBK-2  17B.  To  examine  this  point  in  more  detail,  a  summary  of  the 
contribution  of  non-217B  parts  was  prepared  for  each  of  the  six  equipments 
studied.  The  impact  of  these  parts  was  assessed  in  terms  of  the  parts 
quantity  and  also  the  percentage  of  the  total  failure  rate.  The  results  are 
shown  in  Table  4-2. 

4.4.9  Sources  of  Uncertainity  and  Bias 

In  each  of  the  cases  analyzed,  it  appears  that  further  study,  based  on 
a  larger  sample  of  equipments  having  more  uniformly  distributed  complexi¬ 
ties  may  yield  more  meaningful  results  from  which  predictive  models  for 
nonoperating  failure  rates  can  be  derived.  However,  it  should  also  be 
recognized  that  the  use  of  field  maintenance  data  (from  which  failure  or 
non-failure  data  are  derived  based  on  classification  of  maintenance  action 
records)  imposes  limitations  on  the  confidence  that  can  be  associated  with 
the  analysis  results.  The  limitations  arise  because  the  data  are  influenced 
by  the  maintenance  technician's  choice  of  codes  (How  Malfunctioned  and 
Action  Taken)  used  for  documenting  the  maintenance  actions,  by  the  accu¬ 
racy  and  completeness  of  the  data  recorded  (Job  Control  Number,  Work 
Unit  Code,  etc.),  and  by  the  criteria  used  to  classify  the  maintenance  data 
records  as  either  failures  or  other  (non-failure)  maintenance  actions. 

Another  factor  that  also  is  seen  to  have  an  influence  on  the  data  is  the  type 
of  maintenance  organization  supporting  the  item  (i.e.:  RCM  or  POMO 
maintenance  concept).  In  the  latter  case,  a  definite  trend  toward  less  empha¬ 
sis  on  the  documentation  and  more  emphasis  on  aircraft  sortie  rate  genera¬ 
tion  is  evident  in  the  data.  Needless  to  sav,  these  influences  h.  ve  nothing 
to  do  with  hardware  performance,  but  the  data  when  analv’eri  hv  machine 
methods  without  regard  to  these  factors  aives  the  :  -  :•■•<*» >r.  ‘hat  the  equip¬ 
ment  reliability  has  degraded  under  the  POMO  n  .<  m:  ca  u/ational 

structure. 
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4.5  SELECTED  ANALYSES 


A  correlation  between  some  of  the  key  data  parameters  was  indicated 
in  the  regression  analysis  discussed  in  the  preceding  section.  The  analysis 
methods  utilized  and  the  rationale  behind  their  use  are  discussed  below 
before  the  specific  analyses  performed  are  presented.  There  are  five 
items  of  interest: 

1.  Equipments  that  have  sufficient  data  for  statistical  analysis 

2.  Equipment  age  effects 

3.  Environmental  stress  effects 

4.  Duty  cycle  method  for  failure  rate  derivation 

5. '  Mission  duration  method  for  failure  rate  derivation. 

These  items  are  discussed  below. 


Sufficiency  of  Data 


Equipments  01  and  02  have  far  more  data  than  the  other  four  equip¬ 
ments  (03  through  06).  In  many  cases,  these  two  equipments  were  the  only 
ones  with  sufficient  data  to  permit  a  statistical  analysis.  Therefore,  most 
of  the  selected  analyses  were  concentrated  on  these  two  equipment  types. 


4,  5.  2  Effects  of  Age 

Various  scatter  plots  constructed  without  regard  to  individual  equip¬ 
ment  age,  i.e.,  cumulative  on-time,  showed  widely  scattered  points.  It  was 
suspected  that  the  age  of  the  individual  equipments  may  have  contributed  to  the 
scattering.  Two  experience  curves  of  variation  of  failure  rate  are  show’n  in 
Figure  4-13  as  a  function  of  equipment  age.  The  curve  from  Hughes  data 
reflects  30,  000  equipment  hours  and  53  failures.  The  Honeywell  curve  was 
replotted  from  the  paper  entitled  "The  Effect  of  Endless  Burn-in  on  Reliability" 
by  Bezat  and  Montague  (Reference  39).  This  curve  reflects  more  than  300,000 
equipment  hours  and  over  800  failures.  These  curves  are  approximated  by 
the  following  equation: 

\(t)  =  A  t'°  +kr 
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Figure  4-13.  Relative  failure  rate  versus  equipment  age. 

where 

\(t)  r  Failure  rate  as  a  function  of  time 
A  -  Experience  constant 
t  =  Operating  time 
a  -  Experience  growth  factor 
X  =  Residue  long-term  failure  rate. 

For  a  first  order  approximation,  the  curves  can  be  approximated  as 
straight  lines  on  a  log-log  paper,  as  shown  in  Figure  4-13.  This  means 
the  equation  becomes 


\(t)  =  A  t 

For  this  approximation,  the  respective  a  values  are 

o(Hughes  Curve)  =  0.  29 
o-fHoneywell  Curve)  =  0.  96 
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Using  this  concept,  aging  factors  were  developed  for  use  as  normalizing 
multipliers  for  the  failure  rates  so  that  the  failure  rates  for  all  of  the  equip¬ 
ments  are  compared  at  the  same  age  point.  The  aging  factor  is  expressed  as 


A.F. 


a 


where 

X  =  Failure  rate  at  normalization  age  point 

cl 

\  =  Measured  failure  rate  at  estimated  age  t 
t  =  Normalization  age 
t  =  Estimated  equipment  age. 

For  the  analyses  the  mean  age  of  the  equipments  of  interest  was  used  as  the 
normalizing  age. 

4.5.3  Flight  Stress 

Failure  data  representing  equipment  operated  on  different  aircraft 
sometimes  mask  relationships  that  may  exist  unless  the  data  are  normalized 
to  the  equivalent  environmental  stress  condition.  An  equipment  subjected  to 
higher  stresses  is  expected  to  have  more  failures.  The  following  screening 
expression  from  "Reliability  Growth  and  Screening  Concepts"  (Reference  40) 
developed  at  Hughes  (see  Appendix  C  for  the  derivation  of  the  screening 
expression)  can  be  used  to  evaluate  the  severity  of  the  environment. 

f  =  D  U  (1  -  e'kt) 


where : 


f  =  The  number  of  failures  accrued  during  time  t. 

D  =  Detection  efficiency  and  is  considered  1  for  this  study  since  a 
failure  not  detected  is  not  a  failure. 

U  =  The  number  of  flaws  in  the  equipment  at  the  start  of  the  time 
interval. 

k-  The  environmental  severity  factor, 
t  =  The  time  interval  studied. 
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The  data  representing  the  calendar  year  1978  were  used  to  develop  the 
expression  parameters.  A  computer  program  which  minimizes  the  overall 
error  by  random  point  selection  was  employed  to  find  U  and  k  for  equipments 
01  and  02.  The  results  are  shown  in  Table  4-12.  The  kU  products  reflect 
the  effect  of  the  environment  on  the  equipment  failure  rate.  These  products 
are  utilized  to  normalize  the  failure  data  for  use  in  pooling  of  data  points 
from  different  aircraft  platform  environments  (bombers  versus  fighters). 

As  an  alternate  approach  to  the  development  of  an  environmental  stress 
factor,  the  ratios  of  the  average  failure  rates  for  fighters  versus  bombers 
of  each  of  the  two  equipment  types  were  calculated  and  presented  in  Section 
4.2.3.  The  resultant  fac tor s  for  the  two  methods  were: 

Mean  kU 
Ratio 

Equipment  01  (TACAN)  1.4b 

Equipment  02  (UHF  Radio)  1.60 

The  individual  aircraft  type  failure  rates  within  each  broad  category, 
i.e.  fighter  and  bomber,  as  seen  in  Table  3-7  and  the  kU  products  from 
Table  4-L2  showed  variations  of  10  to  40  percent  from  the  averages  for 
equipments  01  and  02.  Therefore,  the  above  ratios  obtained  via  the  two 
methods  must  be  considered  as  inexact  because  of  limitations  imposed  by 
the  quality  of  the  data  from  which  they  were  derived.  Subsequent  analysis 
results  indicated  that  the  use  of  the  environmental  stress  factor  based  on 
the  mean  failure  rate  ratio  gave  consistently  better  results  as  indicated  by 
the  correlation  coefficients  for  the  two  data  groups.  Therefore,  the  analysis 
results  presented  in  the  following  sections  are  based  on  the  latter  method  of 
environmental  stress  factor  derivation. 

4.5.4  Duty  Cycle  Method 

If  the  following  relationship  is  assumed  for  failures  expected  as  a 
function  of  operating  and  nonoperating  failure  rates,  a  regression  analysis 
can  be  used  to  determine  the  failure  rates  from  data  of  failures  and  times. 

F  ~  fOP  XOP  ~  C.\OP  XNOP  u”'th  fTOT  =  ^P  "  tN3P 
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Mean  Failure  Rate 
Ratio 

1.  27 

1.  51 
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TABLE  4-12.  k  AND  U  FACTORS  FOR  SELECTED  AIRCRAFT 
AND  EQUIPMENT  APPLICATIONS 
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l 


i 


i 


t 


whe  re: 


F  = 


OF 

XOP 

lNOP 


NOP 


Total  number  of  failures  experienced  in  the  total  time  tjQT 
Equipment  operating  time. 

Equipment  operating  failure  time. 

Equipment  nonoperating  time  in  total  time  trQT. 

Equipment  nonoperating  failure  rate. 


Equation  (1)  can  be  written  another  way  by  letting 


D 


duty  cycle 


t 


t 


OP 

TOT 


F  -  t  \  +t  \  —  t 


OP 


OP  OP  NOP  NOP  Tory  tTOT  OP 


lTOT'  tOP 
tTOT 


VoF 


=  t 


lOI 


D  XOP  *  1 


1  - Di  V 


Therefore 


tJOJ  =  D  (KOP  *  XNOP)  '  'WOP  (2) 

This  relationship  is  shown  in  Figure  4-14. 

Unfortunately,  there  are  other  failure  inducing  factors  invoked.  Such 
fac  .ors  include  power  on  off  effects,  environmental  cycling  effects  and  human 
induced  conditions.  If  such  failures  are  not  affected  by  the  operating  or  non¬ 
operating  conditions  then  they  would  appear  as  an  add-on  term  (noise)  to 
Equation  (2),  i.  e.  , 


~TOT  °  ^°F  *  XkOP)  +  Xnop  +  Xn01 


se 


This  relationship  is  shown  in  Figure  .-1: 
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It  is  unfortunate  that  at  the  present  time  X.  noise  cannot  be  segregated 
from  ^NOp-  In  anY  event»  the  intercept  of  the  line  on  the  left  vertical  axis 
will  give  a  first  approximation  to  the  nonoperating  failure  rate,  and  the 
intercept  on  the  right  vertical  axis  indicates  the  operating  failure  rate. 

4.5.5  Mission  Duration  Method 

A  paper  by  M.  B.  Shurman  (Reference  41),  indicated  that  the  cumulat¬ 
ive  flight  failure  curve  as  a  function  of  elapsed  flight  time  takes  the  form  of 
the  curve  shown  in  Figure  4-16.  Following  that  concept,  the  total  number 
of  failures  versus  mission  duration  can  be  plotted  to  obtain  a  curve  similar 
to  the  one  shown  in  Figure  4-17.  For  this  study  this  curve  will  be  con¬ 
structed  using  points  of  average  numbers  of  failures  per  sortie  per  equip¬ 
ment  and  average  mission  durations  for  a  number  of  aircraft  types. 


Figure  4*16.  Cumulative  flight  failures  vs.  mission  duration 
for  jet  aircraft  equipment. 


Figure  4-17.  Cumulative  total  failures  vs.  mission  duration 
for  jet  aircraft  equipment. 

In  Figure  4-17  the  curve  intercept  at  the  vertical  axis  gives  the  residual 
failures  that  are  due  to  nonoperating  stress  and  other  causes.  By  dividing 
the  failure  figures  by  the  appropriate  cumulative  time,  a  failure  rate  can 
be  obtained.  The  slope  of  the  right  end  of  the  curve  will  give  the  operating 
failure  rate. 

The  Duty  Cycle  and  Mission  Duration  analysis  methods  described 
were  used  in  performing  various  analyses  for  estimating  the  failure  rates 
of  interest  to  the  study.  These  analyses  are  individually  discussed  in  the 
following  sections,  and  plots  of  the  data  and  equations  established  by  means 
of  the  CURFIT  regression  analysis  programs  are  also  included. 

4.  5.6  Duty  Cycle  (Percent  Operating  Time)  Regression  Analysis 

Bata  from  equipments  01  and  02  were  utilized  in  the  duty  cycle 
analyses.  Both  annual  and  monthly  failures  per  equipment  versus  percent 
operating  time  plots  were  prepared.  In  each  case,  the  scatter  plots  were 
such  that  several  different  curves  and  curve  types  could  be  drawn  through 
them.  However,  when  both  the  age  factor  and  environmental  stress  factors 
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were  applied  co  all  the  data,  the  goodness  of  fit  as  measured  by  the  index  of 
determination  {square  of  the  coefficient  of  correlation)  was  improved  to  an 
acceptable  value. 

Because  of  differences  in  the  apparent  growth  characteristics  of  the 
two  equipment  types,  the  age  correction  factors  were  derived  using  an 
iterative  regression  analysis  approach  that  resulted  in  the  best  fit  as  indicated 
by  the  index  of  determination  for  each  analysis.  The  values  of  a  used  for  the 
calculation  of  the  age  correction  factors  were  0.  35  and  0.  20  for  equipments 
01  and  02  respectively.  The  resultant  data  matrix,  indicating  the  age  and 
environmental  severity  correction  factors  for  each  equipment  application  and 
the  resultant  effect  on  the  parameter  of  interest,  namely  the  equipment 
failure  rate  per  1000  sorties  is  given  in  Table  4-12. 

The  data  sets  pertaining  to  each  of  the  two  equipment  types  were 
analyzed  using  a  least  squares  fit  regression  analysis  program  called 
CURVFIT. 

The  results  of  the  CURVFIT  analysis  program  indicate  that  a  curve 
of  the  form  Y  =  A  +  B(X)  (straight  line )  is  the  best  fit  in  both  cases.  The  f 

highest  index  of  determination  indicates  that  the  best  equations  are  as 

follows:  ' 

s 

Equipment  01  (TACAN)  F/EQ/YRC  =  0.255  +  ((0.  102)(%  OPTIME))  (4-1) 

Equipment  02  (UHF  Radio)  F/EQ/YRC  =  0.319  +  ((0.229)(%  OPTIME)) 

(4-2) 

F/EQ/YRC  =  Failures  per  equipment  per  year  corrected  for 
age  and  environment 

The  regression  equations  and  corresponding  data  points  for  the  two 
data  sets  representing  equipments  01  and  02  are  plotted  in  Figures  4-18  and 
4- lb  respectively. 

Using  the  equations  from  CURVFIT  for  straight  lines,  the  nonoperating 
and  operating  failure  rates  can  be  calculated. 


Dividing  the  first  term  of  the  equations  relating  to  %  OP  TIME  by  the 
number  of  hours  per  year,  and  letting  %  OPTIME  equal  zero,  yields  the  non 
operating  failure  rate,  X.NOp.  Thus,  for  equipment  01 


StfOPni  =  ~  ^  .  =  29.  1  failures/million  hours  (F/mh) 

1  g760 


The  subscripts  01  and  02  identify  the  respective  equipments. 


The  operating  failure  rate  is  obtained  from  Equation  (4-1)  by  netting 
%  OPTIME  to  100: 


(0.  102)(1  0)^  _  p/  . 

^OPOl  "  29,  1  +  STIjO  F'mh 


The  operating  to  nonoperating  failure  rate  ratio  is: 


,  QPOi  ,1131. 41  o 
NOP01  1 


Similar  computations  are  repeated  for  equipment  02  using  Equation  (4-2) 


F/EQ/YRC  =  0.319  +  ((0,229)  (%OPTIME)) 


and  setting  %  OPTIME  to  zero,  one  obtains 

F/EQ/YRC  =  0.319 

By  repeating  the  previous  steps  for  calculating  the  nonoperating  failure 
rate,  one  obtains 

,ig  .i!y8l--36.4  F/mh 


Dividing  both  terms  of  Equation  (4-2)  by  8760  and  setting  %  OPTIME  equal 
to  100,  the  operating  failure  rate  is  given  by: 

.  „  ,  .  (0.229K10)8  _  ,*C1 
XOP02  =  36-4  + - 57515 -  2651  F/mh 


The  ratio  is: 


*OP02  2651  _  m  o 


4.5.7  Mission  Duration  Regression  Analysis 

The  data  set  representing  failures  per  1000  sorties  per  equipment 
versus  mission  duration  was  analyzed  for  equipments  01  and  02  using  the 
methods  described  in  section  4.  5.  5.  The  CURVFIT  analysis  results  and  the 
regression  equations  and  corresponding  data  points  are  shown  in  Figures  4-20 
and  4-21,  respectively  based  on  the  corresponding  data  from  Table  4-12. 

Selecting  the  equations  having  the  highest  index  of  determination  yields 
the  following  failure  rate  expressions  for  equipments  01  and  02: 

F/KESC  =  0.  187  +  ((1.801)  (MD))  (Table  4-8,  EQ01)  (4-3) 

F/KESC  =  0.457  +  ((3.670)  (MD))  (Table  4-9,  EQ02)  (4-4) 

To  obtain  the  failure  rates  and  ratios  based  on  failures  per  thousand 
sorties  per  equipment  versus  mission  duration  for  equipment  01,  using 
Equation  (4-3)  and  setting  mission  duration  (MD)  equal  to  zero, 

F/KESC  =  0.  187 

The  nonoperating  failure  rate  is: 


NOP  01 


_  (F/KESC)  (Average  No.  of  Sorties  per  Year)(10) 


=  (0-187M177Jt10jf  s3  gF/mh 
8/60 


To  calculate  the  operating  failure  rate  for  equipment  01,  Equation  (4-3)  is 
converted  to 

F/KESC01  =  (Oil8?)  +  (1-801)  (MD) 

K 

in  order  to  include  operating  failures  occurring  during  both  the  mission  time 
and  ground  operating  time. 

The  slope  of  the  line  represented  by  this  equation  is  the  operating  failure 
rate.  Therefore 

1.  801  (10)3 
XOP01  "  K 

=  1385  F/mh  for  K  =  1 .  30 


Taking  the  ratio  of  operating  failure  rate  to  nonoperating  failure  rate  for 
equipment  0 1 , 

VXOP01_  s  1385  64  5 

*NOP01  3.8 

To  obtain  the  failure  rates  and  ratios  based  on  failures  per  thousand 
sorties  per  equipment  versus  mission  duration  for  equipment  02, 

Equation  (4-4)  is  used  to  obtain: 


F/KESC02  =  (0.457)  +  ((3.670)  (MD)) 


and  setting  MD  =  0 


F/KESC02  =  0.457 


The  nonoperating  failure  rate  is 


i  _  (F/KESC02)  (Average  No.  of  Sorties  per  Year)  (10) 

''NOP  02  =  87  SO  (1000)  - 


To  calculate  the  operating  failure  rate.  Equation  (4-4)  is  converted  to: 


F/KESC02  = 


(0.457)  +  (3.  670)  (MD) 
- K - 


The  slope  of  the  line  represented  by  this  equation  is  the  operating 
failure  rate.  Therefore 


3.  670  (10)3 
XOP02  1.30 


=  2823  F/mh 


Following  the  same  procedures  used  for  equipment  01 


^ OPQ2  2823  _ 
\NOP02  '  11.3“ 


249.  8 


The  results  of  the  preceding  analyses  for  equipments  01  and  02  are 
summarized  in  Table  4-14.  To  provide  a  basis  for  comparison  of  the 
results  obtained  using  the  regression  analysis  method  to  those  obtained 
using  the  When  Discovered  method  of  analysis,  the  average  values  of  the 
measured  failure  rates  for  the  censored  data  sets  of  equipments  01  and  02 
are  also  included  in  Table  4-14. 

In  each  of  the  cases  analyzed,  it  appears  that  further  study,  based  on 
a  larger  sample  of  equipments  having  more  uniformly  distributed  complexities 
may  yield  more  meaningful  results  from  which  predictive  models  foi  non¬ 
operating  failure  rates  can  be  derived.  However,  it  should  also  be  recognized 
that  the  use  of  failure  maintenance  data  (from  which  failure  or  non-failure 
data  are  derived  based  on  classification  of  maintenance  action  records) 
imposes  limitations  on  the  confidence  that  can  be  associated  with  the  analysis 
results.  The  limitations  arise  because  the  data  are  influenced  by  the  main¬ 
tenance  technician's  choice  of  codes  used  for  documenting  the  maintenance 
actions,  by  the  accuracy  and  completeness  of  the  data  recorded  and  by  the 
criteria  used  to  classify  the  maintenance  data  records  as  either  failures  or 
other  (non-failure)  maintenance  actions. 


TABLE  4-14.  SUMMARY  OF  DC  AND  MD  ANALYSIS  RESULTS 
(AGE/ENV  CORRECTION) 


Failure  Rates*  and  Ratios 

Based  on  Duty  Cycle  Analysis 

Equipment  01 

Equipment  02 

XOP 

1193 

2651 

X  NOP 

29.  1 

36.4 

x  OP/xNOP 

41.0 

72.8 

Failure  Rates*  and  Ratios  Based 
on  Mission  Duration  Analysis 

Equipment  01** 

Equipment  02 

\  OP 

1385 

2823 

X  NOP 

3.  8 

11.3 

X  OP/xNOP 

364.5 

249.  8 

Average  Failure  Rates*  and  Ratios 
Based  on  Measured  Data 

Equipment  01 

Equipment  02 

x  TOT 

1545 

2726 

xOP 

1401 

2417 

xNOP 

7.4 

18.  3 

XOP/xNOP 

188.4 

131. 8 

*Failure  rates  are  in  failures  per  million  hours  (F/mh) 

**Analysis  results  based  on  age  correction  only 

While  i  is  true  that  some  interesting  relationships  were  developed 
using  all  three  methods  described  in  the  preceding  sections  for  the  assess¬ 
ment  of  nonoperating  failure  characteristics  of  avionic  equipment  during  this 
study,  the  inconsistent  results  reflect  the  influence  of  uncontrolled  variables 
in  the  source  data  available  for  the  analysis  tasks. 

A  review  of  the  maintenance  data  characteristics  and  a  discussion  of 
other  factors  which  appear  to  influence  the  resultant  data  base  is  given  in 
Section  4.  6. 
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4.  6  OBSERVATIONS  REGARDING  MAINTENANCE  DATA  CHARACTERISTICS 

Although  methods  for  assessing  the  reliability  performance  of. airborne 
avionic  equipments  based  on  USAF  field  maintenance  data  were  successfully 
developed  and  used  on  the  previously  completed  OIR  study  (Reference  6),  it 
has  become  evident  during  the  work  done  on  this  study  that  the  same  data 
does  not  yield  consistent  results  with  which  to  characterize  the  nonoperating 
failure  characteristics  of  avionic  equipments. 

Because  of  concern  regarding  these  apparent  inconsistencies,  a  care¬ 
ful  review  of  other  factors  that  might  explain  the  differences  was  made.  The 
conclusion  reached  following  numerous  discussions  with  the  responsible 
logistics  personnel  at  all  levels  (base,  depot,  and  Command  Headquarters) 
was  that  the  differences  stem  from  two  different,  but  related,  factors.  The 
first  factor  relates  to  differences  in  the  documentation  of  maintenance  actions 
on  the  same  equipment  among  the  various  commands  and/or  bases  of  interest 
to  the  study.  The  second  factor  relates  to  the  functional  characteristics  of 
a  given  type  of  equipment. 

Examples  of  differences  in  the  documentation  of  maintenance  actions 
are  seen  in  the  quality  (incidence  of  incorrect,  incomplete  or  missing  records) 
of  the  data  as  well  as  the  choice  of  codes  used  to  document  the  When  Dis¬ 
covered  (WD)  or  How  Malfunctioned  entries  on  the  maintenance  records.  Dif¬ 
ferences  in  documentation  (and  the  resultant  data)  are  also  seen  as  a  function 
of  the  type  of  maintenance  organization. supporting  the  item  (i.  e;  RCM  or 
POMO  maintenance  concept).  In  the  latter  case,  a  definite  trend  toward  less 
emphasis  on  the  documentation  and  more  emphasis  on  aircraft  sortie  rate 
generation  is  evident  in  the  data.  Needless  to  say,  these  influences  have 
nothing  to  do  with  hardware  performance,  but  the  data  when  analyzed  by 
machine  methods  without  regard  to  these  factors  gives  the  impression  that  the 
equipment  reliability  has  degraded  under  the  POMO  maintenance  organizational 
structure. 

The  equipment  functional  characteristics  that  are  reflected  in  the  data 
relate  to  the  mission  essentiality  (is  it  a  critical  function,  or  a  secondary 
convenience  item  )  and  failure  detectability  features  of  the  equipment.  For 
equipments  that  are  primary  mission  essential,  one  would  expect  the  user  to 
be  more  critical  of  performance  discrepancies,  hence  report  malfunctions 
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more  frequently  than  if  the  item  were  of  a  lesser  level  of  mission  essentiality. 
Another  of  the  equipments  functional  chracteristics  relates  to  the  exent  to 
which  performance  discrepancies  are  detectable  and  the  use  conditions  undevr 
which  they  are  detectable.  For  example,  for  some  types  of  equipment,  dis¬ 
crepancies  can  be  detected  quite  readily  while  the  aircraft  is  on  the  ground, 
whereas  for  other  types  of  equipment  most  discrepancies  (including  nonoper¬ 
ating  failures  would  only  be  detected  during  flight.  In  the  latter  case,  these 
failures  would  be  classified  as  operating  failures  even  though  many  of  them 
may  really  have  been  nonoperating  failures.  This  detectability  characteristic 
is  particularly  true  of  the  ARN-131  OMEGA  low  frequency  navigation  set, 
and  to  a  lesser  extent  also  true  of  the  ARN-118  TACAN  navigation  set 
(Equipments  06  and  01  respectively).  Both  of  these  equipments  therefore 
exhibit  somewhat  higher  than  expected  operating  to  nonoperating  failure  rate 
ratios  and  correspondingly  lower  nonoperating  failure  rates. 

When  the  differences  in  Air  Force  maintenance  organizational  struc¬ 
tures  (Reliability  Centered  Maintenance  per  AFM  66-1  versus  Production 
Oriented  Maintenance  Organization  per  AFM  66-5)  and  maintenance  practices 
implemented  under  the  RCM  or  POMO  organizations  are  also  considered,  it 
becomes  quite  apparent  that  still  another  variable  (not  in  any  way  equipment 
performance  related)  can  affect  the  data  collected  by  the  field  maintenance 
data  collection  system. 

It  is  believed  that  the  combined  effects  of  the  differences  in  the  equip¬ 
ment  functional  characteristics,  the  documentation  of  maintenance  actions, 
and  differences  in  maintenance  organizational  structures  can  cause  signifi¬ 
cant  differences  in  the  data  which  in  turn  may  lead  to  misleading  analysis 
results  if  not  properly  recognized. 

The  analysis  results  and  the  major  findings  of  the  study  are  sum¬ 
marized  in  Section  5.  0.  The  conclusions  and  recommendations  resulting 
from  the  study  follow  in  Section  6.  0. 
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5.  0  SUMMARY  OF  ANALYSIS  RESULTS 


The  data  on  which  this  study  was  based  are  comprised  of  the  field 
maintenance  data  for  the  calendar  year  ending  31  December  1978  for  six 
different  AN-designated  avionic  equipment  types  installed  on  32  different 
equipment/aircraft  applications  among  17  different  aircraft  types.  Collec¬ 
tively  these  data  represent  more  than  3.8  million  equipment  flight  hours, 

8,255  equipments,  and  some  17,500  maintenance  action  record  sets  which 
document  about  10,600  equipment  failures. 

The  major  results  of  the  analysis  are  as  follows.  The  calculated 
MTBF  (using  only  failures  detected  during  operating  periods)  was  an  aver¬ 
age  23  percent  higher  for  the  six  equipment  types  investigated  than  the  Air 
Force  reported  MTBF  (which  included  all  failures).  The  MTBF  difference 
was  more  than  50  percent  for  the  Cl  108  video  monitor.  The  MTBF  improve¬ 
ment  factors  derived  for  each  of  the  equipment  types  studied  are  presented  in 
Figure  5-1.  Comparable  values  were  obtained  using  two  other  indirect 
methods  for  the  ARN-118  TACAN  and  the  ARC -164  UHF  radio,  as  shown  in 
Table  5-1.  Comparing  the  operating  to  nonoperating  failure  rate  ratios  indi¬ 
cates  that  this  characteristic  varies  over  a  wide  range  as  shown  in  Figure  5-2. 
The  average  ratios  of  measured  operating  to  nonoperating  failure  rates  for  the 
six  equipment  types  investigated  ranged  between  41  and  188  and  had  an  average 
value  of  113.  This  method,  however,  possibly  overestimates  the  ratio, 
because  some  failures  that  occur  during  nonoperating  time  are  not  detectable 
while  the  aircraft  is  on  the  ground;  hence,  they  are  counted  as  operating 
failures  even  though  they  may  have  occurred  during  nonoperating  time.  The 
ratios  estimated  for  the  ARN-118  TACAN  and  the  ARC-164  UHF  radio  by 
means  of  the  Duty  Cycle  analysis  method  were  found  to  be  41  and  73  respec¬ 
tively  compared  to  188  and  132  with  the  When  Discovered  (WD)  method. 
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Figure  5-1.  MTBF  improvement  factor.  Figure  5-2.  Ratio  of  operating  to  nonoperating 

failures. 

TABLE  5-1.  MTBF  IMPROVEMENT  OVER  AIR  FORCE  REPORTED  MTBF 


Analysis  Method 

Based  on  Equipment 

MTBF  Improvement,  % 

WD  (When  Discovered) 
(By  deleting  failures 
discovered  during  non¬ 
operating  period) 

All  6  Equipments 

22.7 

ARN-118  TACAN 

8.6 

ARC -164  UHF  Radio 

12.3 

DC  (Duty  Cycle) 
Regression  Analysis 

ARN-118  TACAN 

29.5 

ARC -164  UHF  Radio 

2.8 

MD  (Mission  Duration) 
Regression  Analysis 

ARN-118  TACAN 

11.6 

ARC -164  UHF  Radio 

-3.4 

The  failure  rates  predicted  and  calculated  from  field  data  by  means 
of  several  methods  are  summarized  in  Table  5-2.  Only  equipments  01  and 
02  provided  a  sufficient  number  of  data  points  for  analysis  using  the  Duty 
Cycle  (DC)  or  the  Mission  Duration  (MD)  regression  methods.  The  ratios  of 
nonoperating  to  operating  failure  rates  are  also  included  in  Table  5-3  to  pro¬ 
vide  another  index  by  which  to  compare  the  results. 


TABLE  5-3.  RATIOS  OF  OPERATING  TO  NONOPERATING 

FAILURE  RATES 


Predicted 

Field  Measured* 

Equipment 

Number 

HDBK 

217B 

217B 

RADC 

217B 

MIRA  DCOM 

WD 

Method 

DC 

Method 

MD 

Method 

01 

2.83 

9.64 

28.42 

186.4 

41.0 

364.  5 

02 

2.21 

4.68 

8.  10 

131.8 

72.8 

249.8 

03 

5.72 

7.19  , 

35.  66 

100.7 

n/a 

N/A 

04 

1.49 

14.29 

36.89 

40.  9 

n/a 

n/a 

05 

3.44 

3.  62 

/  9.81 

44.9 

n/a 

n/a 

06 

1.53 

7.91 

24.  61 

186.  0 

n/a 

n/a 

*See  Table 

5-1  for  description  of  methods. 

The  failure  rates  obtained  by  means  of  the  WD  method;  i.e.,  categorized 
according  to  the  When  Discovered  Codes  (WDC),  are  subject  to  variation  in 
failure  detectability  and  WDCs  reported.  The  failure  rates  obtained  by  means 
of  regression  analysis  are  failure  detectability  and  WDC  free  as  the  failure 
rates  are  established  from  curves  rather  than  failure  counts.  This  means 
that  the  classification  of  a  failure  as  either  operating  or  nonoperating  is  not 
contingent  on  the  use  of  the  WDC  in  documenting  the  maintenance  action. 

To  place  the  failure  rates  in  proper  perspective  it  is  necessary  to 
relate  the  rates  to  the  expected  environmental  conditions.  Such  a  plot  is  shown 
in  Figure  5-3.  The  failure  rates  for  each  equipment  type  are  normalized  in 
Figure  5-3  to  the  observed  operating  failure  rate  of  that  equipment.  The 
operating  failure  rate  point  A,  which  has  the  value  of  one,  serves  as  the 
starting  point.  This  point  is  located  at  the  environmental  level  A^,  a  level 
that  approximates  the  level  the  operating  equipments  experienced.  The  scale 
on  the  figure  is  used  to  mark  the  various  environmental  levels  roughly  in 
accordance  with  the  *£  numerical  values  given  in  MIL-HDBK-217B. 

The  points  in  group  B  wrre  obtained  by  dividing  each  observed  non¬ 
operating  failure  rate  by  its  corresponding  operating  failure  rate.  The  circled 
points  were  from  the  analyses  based  on  the  WDC.  The  triangles  were  from 


environmental  level,  *e 


Figure  5*3.  Graphical  relationship  of  failure  rates. 


the  MD  and  DC  analyses.  It  is  believed  that  the  nonoperating  environmental 
condition  for  the  observed  failure  rates  approximates  a  level  somewhere 
between  ground  fixed  (Gp)  and  ground  mobile  (Gj^)  environmental  levies.  The 
numbers  associated  with  the  data  points  signify  the  six  equipment  types 
investigated  (01  through  06).  The  averages  of  the  circled  points  are  labeled 
AVG.  The  broken  line  connecting  point  A  and  the  AVG  point  of  group  B  shows 
roughly  how  the  field  observed  failure  rates  vary  from  operating  conditions 
to  nonoperating  conditions. 

The  points  in  groups  C,  D,  E  and  F  were  obtained  by  dividing  each 
predicted  failure  rate  by  the  corresponding  observed  operating  failure  rate. 
All  of  the  points  were  normalized  to  the  observed  operating  failure  rates 
from  the  analyses  based  on  the  WDC.  Again,  the  numbers  next  to  the  points 
signify  the  equipment.  The  operating  failure  rate  predictions  for  group  C 
were  based  on  MIL-HDBK-21  7B  and  manufacturers'  estimates  for  parts  not 
covered  by  the  handbook.  The  nonoperating  failure  rate  predictions  for 
group  D  were  based  on  RADC-TR-  73-248  (Reference  34),  on  dormant  failure 
rates.  Those  for  group  E  were  based  on  the  nonoperating  failure  rates  from 
LC-78-1,  Missile  Materiel  Reliability  Prediction  Handbook  (Reference  36). 
Those  for  group  F  were  derived  from  MIL-HDBK-21  7B  using  zero  stress, 
30°C  and  ground  fixed  conditions,  and  manufacturers'  estimates  for  parts 
not  covered  by  the  handbook.  In  general,  environmental  conditions  for  the 
nonoperating  failure  rate  for  the  purpose  of  predictions  are  assumed  to  be 
close  to  the  ground  fixed  (Gp)  level. 

Note  that  the  observed  nonoperating  failure  rates  from  the  two  analysis 
methods  were  lower  than  those  predicted  by  both  the  RADC  and  MIRADCOM 
prediction  methods  used.  Because  a  failure  cannot  be  detected  without 
energizing  the  equipment,  it  is  very  possible  that  the  nonoperating  failure 
rates  from  the  two  prediction  documents  contain  some  turn-on  and  test 
induced  failures.  However,  considering  the  impact  of  failure  detected  at 
the  time  of  initial  turn-on,  i.  e.  :  unavailability  of  the  system  to  perform  its 
function,  it  is  academic  whether  the  failure  occurred  during  turn-on  or 
while  the  equipment  was  not  energized  (off). 

Conclusions  pertaining  to  critical  analysis  results  are  contained  in  the 
next  section. 


6.0  CONCLUSIONS  AND  RECOMMENDATIONS 


As  a  result  of  this  study,  it  has  become  clear  that  there  are  no 
simple  means  for  assessing  nonoperating  failure  rates,  let  alone  defining  what 
constitutes  a  nonoperating  failure  in  a  way  that  is  acceptable  to  the  majority 
of  users.  For  this  reason,  it  appears  that  perhaps  a  mor  ;  pragmatic 
definition,  based  on  consideration  of  the  end  user's  needs  would  be  most 
appropriate.  For  those  interested  in  making  relaibility  predictions  or 
assessments,  nonoperating  failure  rate  could  encompass  all  failures  that 
occurred  during  non-mission  time.  Similarly  for  an  assessment  of  logistics 
resource  impact,  it  is  necessary  to  know  what  the  failure  rate  of  the  equip¬ 
ment  is  when  it  is  not  operated  or  when  it  is  in  storage.  Therefore,  in  this 
study,  nonoperating  failure  rates  were  derived  using  several  methods.  The 
values  and  ratios  of  nonoperating  and  operating  failure  rates,  and  MTBF 
improvements  are  presented  in  the  section  on  Summary  of  Analysis  Results. 
The  following  gives  overall  conclusions  and  recommendations  on  specific 
precautions  to  be  taken  on  future  studies  involving  field  data. 

CONCLUSIONS 


1.  Nonoperating  failures  have  a  measurable  effect  on  assessed 
operational  MTBF  of  avionic  equipment.  For  the  equipments 
studied  the  average  non-operating  failure  contribution  is 
approximately  10  to  30  percent  of  the  total  number  of  failures 
for  typical  utilization  rates  of  20  to  60  hours  per  month. 
Therefore,  it  is  imperative  that  only  operating  failures  be 
counted  in  mission-oriented  failure  rate  determination. 

2.  Field  nonoperating  failure  rates  cannot  be  predicted  to  a  reason¬ 
able  degree  of  accuracy  using  any  of  the  established  prediction 
methods.  The  data  for  the  six  equipment  types  investigated 
preclude  the  establishment  of  any  consistent  relationships  between 
predicted  and  measured  nonoperating  failure  rates. 


3.  The  analysis  results  did  not  verify  the  current  belief  that 
microelectronic  parts  have  a  lower  ratio  of  operating  to  non¬ 
operating  failure  rates  than  other  types  of  parts.  This  finding, 
however,  may  be  due  to  a  number  of  other  variables  affeoting 
the  data  on  which  this  study  was  based. 

4.  Environmental  severity  factors  (ESFs)  appear  to  be  both  equipment 
and  platform  dependent.  This  indicates  that  the  development  of 
only  average  ESF  or  similar  factors,  such  as  ttjt,  for  all  types 

of  avionic  equipment  may  give  very  erroneous  results  with  respect 
to  a  specific  equipment  type. 

R  EC  OMM  ENDA  TIONS 

1  .  Any  study  of  the  effects  of  environmental  stress  on  avionic 
equipment  failure  rates  should  also  consider  the  influence  of 
other  factors  such  as  equipment  function  and  maintenance  policy 
on  the  equipment's  field  failure  rate. 

2.  Age  has  a  significant  influence  on  the  magnitude  of  the  failure 
rate  at  any  point  of  time.  Therefore,  effects  of  age  must  be 
normalized  in  any  failure  rate  studies  that  involve  equipments 
having  a  variety  of  ages. 

3.  To  permit  more  meaningful  inferences  to  be  drawn  from  the  data 
base  used  for  studies  of  this  type,  future  studies  should  be  planned 
to  include  equipments  with  the  following  characteristics: 

a.  Relatively  uniform  and  constant  equipment/platfform  combi¬ 
nation  population  throughout  the  study  period  so  that  vari¬ 
ation  due  to  equipment  age  and  flaw  removal  rates  can  be 
minimized. 

b.  Each  equipment  type  should  be  on  several  different  aircraft 
types  (more  than  four  if  possible)  for  each  category  (bomber, 
fighter,  etc.  )  of  interest  in  which  the  equipment  is  used. 

c.  The  equipment  types  selected  should  have  a  uniformly  distri¬ 
buted  range  of  complexity  to  prevent  biasing  of  analysis 
results  by  equipment  with  extremely  high  or  low  complexities. 

4.  Differences  in  the  maintenance  action  documentation  procedures 
as  implemented  by  the  various  operating  commands  and/or  bases 
should  be  further  investigated  so  that  the  influence  of  the  documentation 
procedural  differences  can  be  accounted  for  in  the  performance 
assessment  process  by  those  using  maintenance  data  collection 
system  (MDCS)  data  for  studies  similar  to  the  one  reported  on 
herein. 


7.0  DEFINITIONS 


AGEHRS 

ALC 

AT 

BIT 

CND 

CONUS 

DCM 

DORMANT 


Age  in  Hours.  The  average  equipment  age  at  the  end  of  the 
period  of  interest  expressed  in  operating  hours. 

Air  Logistics  Center. 

Action  Taken  Code.  The  action  taken  code  is  used  to  identify 
the  maintenance  action  that  was  taken,  such  as  remove  and 
replace.  Action  taken  codes  are  standard  for  all  equipment 
and  are  listed  in  all  work  unit  code  manuals.  A  complete  list 
of  authorized  Action  Taken  codes  is  contained  in  AFM  300-4, 
Volume  XI. 

Built  In  Test.  BIT  includes  all  of  the  special  circuitry  and 
software  designed  into  an  avionic  system  to  verify  that  the 
system  is  operative  or,  if  the  system  is  indicated  to  be  not 
fully  operative,  to  isolate  the  fault  to  an  element  of  the  system 
which  can  be  removed  and  replaced  to  correct  the  condition. 

Cannot  Duplicate.  A  reported  discrepancy  which  cannot  be 
duplicated  (or  verified)  upon  retest  at  either  "0"  level  or 
"I"  level  of  maintenance. 

Continental  United  States. 

Deputy  Commander  for  Maintenance.  The  commanding  officer 
in  charge  of  maintenance  activities  at  the  base  level. 

Dormancy  is  the  state  wherein  a  component  or  equipment  is 
connected  to  a  system  in  the  normal  operational  configuration 
and  experienced  below  normal  and/or  periodic  operational 
stresses  and  environmental  stresses,  but  is  not  energized  or 
otherwise  operated.  The  system  may  be  in  a  dormant  state 
for  periods  ranging  from  several  hours  to  over  2,  000  hours 
between  operational  missions  for  USAF  aircraft.  For  the 
purposes  of  this  study,  dormancy  is  considered  to  be  an  ele¬ 
ment  of  the  nonoperating  condition. 
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ibaV'ife'-'V-  - 


EFHRS 

EOHRS 

EUR 

EQ 

FAILS  (F) 


FHRS 

F/SRTIE 


F/KSRTY 
FNOP 
FOP 
FT  OT 
GT 


HOW  MAL 


Equipment  Flight  Hours.  The  number  of  equipment  flight  hours 
accumulated  during  a  given  time  interval  (EFHRS=FHRS(QPA)). 

Equipment  Operating  Hours.  The  number  of  equipment  operat¬ 
ing  hours  accumulated  during  a  given  time  interval  (i.  e.  , 

EOHRS  =  EFHRS(K)). 

Equipment  Utilization  Rate,  UR(K) 

Equipment  Number.  The  numeric  equipment  designator  (01 
through  06)  assigned  for  convenience  of  notation  when  referring 
to  the  equipment  in  the  data  set. 

Failure  Occurences  (F).  The  D056  computer  definition  of  a 
failure  occurrence  related  to  a  Work  Unit  Code  is:  "any 
Type  1  How  Malfunctioned  code  reported  in  combination  with 
an  action  taken  indicating  repair,  adjustment  or  item  replace¬ 
ment  and  one  or  more  units  produced".  A  Type  1  How  Mal¬ 
functioned  code  indicates  that  the  item  no  longer  can  meet  the 
minimum  specified  performance  requirement  due  to  its  own 
internal  failure  pattern. 

Flight  Hours.  The  number  of  aircraft  flight  hours  as  reported 
in  AFM  65-1  10  under  active  aircraft  inventory  flying  time 
during  a  given  time  interval. 

Failures  per  Sortie.  The  average  annual  failure  rate  expressed 
in  terms  of  failures  per  sortie,  i.  e.  , 

„  Total  Failures  FT  OT  x  MD 

F/SRTIE  =  - Sorties - EFHRS- 

Failures  per  1000  Sorties 
Nonoperating  Failures 
Operating  Failures 
Total  Failures 

Ground  Operating  Time.  The  operating  time  accumulated 
by  a  given  item  of  equipment  on  the  aircraft  while  the  air¬ 
craft  is  operating  on  the  ground  under  control  of  the  flight 
crew  during  a  typical  mission. 

How  Malfunctioned  Code.  The  How  Malfunctioned  code  is 
used  to  identify  how  the  equipment  malfunctioned,  such  as 
cracked.  To  provide  maximum  utility,  these  codes  are  also 
used  to  identify  time  compliance  technical  order  status 
requirements,  or  to  show  that  a  maintenance  action  did  not 
result  from  a  defect.  A  complete  list  of  authorized  How 
Malfunctioned  codes  is  contained  in  AFM  300-4,  Volume  XI. 

How  Malfunctioned  codes  are  listed  in  each  work  unit  code 
manual  for  each  individual  type  of  equipment  in  both  alpha¬ 
betic  and  numeric  order. 
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"I"  LEVEL 


IM 

INV 

IROS 

K 

LAM  NOP 

LAMOP 

LAMTOT 

LOGISTIC 
CY  c'LE 


LSC 


LRU 


Intermediate  Level  of  Maintenance.  For  avionics  systems, 
intermediate-level  maintenance  include  all  base-level  main¬ 
tenance  performed  at  locations  other  than  at  the  aircraft. 

It  includes  performing  checks  and  corrective  maintenance  on 
LRUs  and  may  include  performing  bit-and-piece  repaid  on 
SR  As. 

Item  Manager.  The  individual  responsible  for  the  manage¬ 
ment  of  an  inventory  item  (such  as  an  item  of  avionics 
equipment)  at  an  ALC. 

Inventory.  The  number  of  aircraft  systems  in  the  active 
inventory  as  reported  in  65  —  1 10  status  report. 

Increased  Reliability  of  Operational  Systems.  The  USAF 
Logistic  Support  Cost  reporting  system  implemented  by  AFLC 
Regulation  400-16. 

Use  Factor.  The  ratio  of  -equipment  operating  hours  to  equip¬ 
ment  flighc  hours. 

Nonoperating  Failure«  Rate,  X^Qp,  10^  4  MTBFNON 
Operating  Failure  I^ate,  X^p,  10^  4  MTBFOP 
Total  Failure  Rate, 

The  Logistic  Cycle  is  the  typical  sequence  of  events  that  an 
item  is  exposed  to  during  the  performance  of  maintenance 
until  it  is  again  returned  to  its  operational  role.  Typically, 
this  cycle  can  have  a  duration  of  from  several  weeks  to  over 
one  year. 

Logistic  Support  Costs.  Costs  associated  with  supporting  an 
item;  includes  costs  of  base  labor,  b^se  material,  costs  to 
replace  condemnations,  transportation  and  shipping  costs  for 
non-base  repairable  items,  technology  repair  center  costs, 
and  others  when  the  cost  is  quantifiable  and  meaningful  for 
effectiveness  analysis. 

Line  Replaceable  Unit.  An  LRU  is  an  element  of  an  avionic 
system  ("black  box")  which  can  be  removed  and  replaced  by 
organizational-level  maintenance  personnel.  LRU's  which  are 
faulty  or  suspect  are  removed  from  the  aircraft  and  replaced 
with  operative  LRUs.  The  removed  LRU  is  sent  to  an 
intermediate-level  shop  for  maintenance. 


MD 

MDCS 

MDS 

MI 

MMHRS 

MTBFNOP 

MTBFOP 

MTBFTOT 

MTBMA 

(EFH) 

MTBMA 

(EOHI 

NOPTIME 


Mission  Duration.  The  average  weapon  system  mission 
duration,  expressed  in  hours  (derived  from  annual  flight 
hours  divided  by  annual  sorties  flown). 

Maintenance  Data  Collection  System.  The  standard  U$AF  mainte¬ 
nance  data  collection  system  (MDCS)  defined  in  AFM  66-1. 

Miss  ion- Design-Series.  The  term  MDS  refers  to  the  aircraft 
system  designator  (i.  e.  ,  C-5A,  F-4E,  KC-135,  etc.). 

Maintenance  Index.  The  number  of  unscheduled  maintenance 
manhours  per  equipment  operating  hour  expended  to  support 
the  equipment  item.  The  time  base  can  be  equipment  oper¬ 
ating  hours  or  equipment  flight  hours; 

Total  Maintenance  manhours  4  (QPA  x  FHRS) 


Maintenance  Manhours.  The  number  of  unscheduled  mainten¬ 
ance  manhours  expended  in  support  of  a  given  article  as 
reported  in  Mi e  D056  maintenance  data  summaries  by  WUC. 

Nonoperating  Mean  Time  Between  Failures. 


Operating  Mean  Time  Between  FaTures, 


K  x  CPA  x 


FHRS 

FCP 


Total  Mean  Time  Between  Failures, 


K  x  QPA  x 


FHRS 

FTOT 


Mean  Time  Between  Maintenance  Actions  (EFH).  The  value 
obtained  by  di\iding  the  number  of  equipment  flight  hours  by 
the  number  of  maintenance  actions  as  reported  in  the  D056 
maintenance  data  summaries  by  WUC. 


Mean  Time  Between  Maintenance  Actions  (EOHI-  The  value 
obtained  by  dividing  the  number  of  equipment  operating  hours 
by  the  number  of  maintenance  actions  as  reported  in  the  D056 
maintenance  data  summaries  by  WUC. 

Nonoperating  Time.  The  number  of  nonoperating  hours 
accumulated  by  an  item  of  equipment  during  both  dormant  and 
storage  periods.  See  definitions  of  dormancy  and  storage 
also. 
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NRTS 


OP  TIME 

"O"  LEVEL 

OP/ NOP 
P 

PI 

QPA 

R 

REMS 

SM 

SORTIE 

(SRTY) 


Not  Repairable  This  Station.  Identifies  an  item  of  hardware 
which,  for  any  of  a  variety  of  reasons  (including  policy,  tech¬ 
nical,  and  economic),  is  not  designated  to  be  repaired  at  the 
base  level. 

» 

Operating  Time.  The  number  of  operating  hours  accumulated 
by  an  item  of  equipment  during  both  weapon  system  operations 
and  operation  during  the  performance  of  maintenance. 

Organizational  Level  of  Maintenance.  Maintenance  performed 
by  a  using  organization  on  its  own  equipment.  For  avionic 
equipment,  organizational  maintenance  is  performed  at  the 
aircraft. 

Ratio  of  operating  failure  rate  to  nonoperating  failure  rate. 

Predicted  MTBF  (P).  The  predicted  value  of  MTBF  as 
reflected  in  the  equipment  manufacturer's  final  reliability 
prediction  report. 

Predicted  MTBF  (PI).  The  reassessed  value  of  the  predicted 
MTBF  based  on  the  methods  described  in  Section  3  of  this 
report. 

Quantity  per  Application.  This  is  the  quantity  of  identical 
installed  items  on  a  single  unit  of  equipment  that  are  report- 
able  under  the  same  WUC. 

Required  MTBF  (R).  The  required  value  of  equipment 
MTBF  (e0)  expressed  in  equipment  operating  hours  as  defined 
in  the  equipment  procurement  specification. 

Removals.  The  number  of  maintenance  actions  coded  as 
removed  for  the  equipment  as  reported  in  the  D056  mainte¬ 
nance  data  summaries  by  WUC. 

System  Manager.  The  individual  responsible  for  the  manage¬ 
ment  of  an  operational  weapon  system  at  the  ALC  designated 
for  the  weapon  system. 

Sortie .  A  sortie  begins  at  the  initiation  of  the  takeoff  roll  of 
the  aircraft  at  the  beginning  of  a  flight,  and  ends  5  minutes 
after  landing  of  the  aircraft  and/or  engine  shutdown  following 
landing,  whichever  event  occurs  first. 


STORAGE 


Storage  is  defined  as  the  state  wherein  an  equipment  is  not 
connected  to  a  system,  but  is  in  a  supply  storage  status, 
with  or  without  protective  packaging,  and  during  which  time 
it  experiences  somewhat  more  benign  environments  than 
when  in  the  dormant  state. 

SPO  System  Program  Office 

TMAS  Total  Maintenance  Actions.  The  total  number  of  maintenance 

actions  reported  against  a  given  WUC  as  reported  in  the 
D056  maintenance  data  summaries. 


TMAXX 


TOT/NOP 

UR 


WD 


WUC 


w/s 


Total  Maintenance  Actions-Functional  Subsystem.  The  tot>d 
number  of  maintenance  actions  reported  against  the  equipment 
functional  subsystem  as  reported  in  the  D056  maintenance 
data  summaries. 

Ratio  of  total  failure  rate  to  nonoperating  failure  rate. 

Utilization  Rate.  The  utilization  rate,  expressed  in  terms  of 
flight  hours  per  month  per  aircraft  using  the  flight  hours  and 
inventory  values  reported  in  the  65-110  system  operational 
status  summaries. 

When  Discovered.  The  When  Discovered  code  is  used  to  identify 
when  a  discrepancy  requiring  maintenance  action  was  discov¬ 
ered,  such  as  during  a  quality  control  inspection.  When  Discov¬ 
ered  codes  are  listed  in  each  work  unit  code  manual  for  individual 
types  of  equipment. 

Work  Unit  Code.  The  work  unit  code  consists  of  five  charac¬ 
ters,  and  is  used  to  identify  the  system,  subsystem,  and 
component  on  which  maintenance  is  required  or  on  which 
maintenance  was  accomplished.  These  codes  are  published 
in  work  unit  code  manuals  for  each  weapon  and  support 
system.  The  first  two  positions  of  the  work  unit  codes  for 
aircraft  identify  functional  systems,  such  as  flight  control 
system,  antenna  system,  or  launch  control  system.  The 
third  and  fourth  positions  of  the  work  unit  code  identify  sub¬ 
system  or  major  assembly.  The  fifth  position  of  the  work 
unit  code  normally  identifies  repairable  items. 

Weapon  System.  For  the  purposes  of  this  report,  this  term 
is  considered  to  refer  to  a  formally  designated  operational 
aircraft  system,  regardless  of  whether  the  aircraft  is  a 
fighter,  interceptor,  bomber,  transport,  trainer,  or  other 
mission  type. 


%ABO 


%ADJ 

%COND 

%FAIL 

%NOP 

ToOPTIME 

VoNRTS 

TcRFMS 

TcSHOP 

To799 

%800 


%  Aborts.  The  percentage  of  all  D056  reported  unscheduled 
maintenance  actions  on  which  the  equipment  item  malfunction 
was  reported  as  associated  with  a  mission  abort. 

%  Adjustments.  The  percentage  of  all  D056  reported  unsche¬ 
duled  maintenance  actions  on  which  the  equipment  item 
maintenance  action  taken  was  reported  as  "Adjustment". 

%  Condemnations.  The  percentage  of  all  D056  reported 
unscheduled  maintenace  actions  on  which  the  equipment 
item  maintenance  action  taken  was  reported  as  "Condemned  '. 

%  Failed.  The  percentage  of  all  D056  reported  unscheduled 
maintenance  actions  which  are  classified  as  "Failures"  in 
the  D056  reports  summarizing  AFM  66-1  MDC  data  analysis 
results. 

%  Nonoperating  Failure.  The  ratio  of  nonoperating  to  total  fail 
ures  expressed  as  a  percentage. 

Percent  Operating  Time.  The  ratio  of  operating  time  to  total 
calendar  time  expressed  as  a  percentage. 

%  Not  Repairable  This  Station.  The  percentage  of  all  D056 
reported  unscheduled  maintenance  actions  on  which  the 
equipment  item  is  reported  as  Not  Repairable  This  Station 
(NRTS)  and  must  be  sent  to  a  Depot  or  Special  Repair  Activity 
(SRA )  for  repair. 

%  Removals.  The  percentage  of  all  D056  reported  unscheduled 
maintenance  actions  on  which  the  equipment  item  is  reported 
as  "Removed"  from  the  aircraft  and  must  be  sent  to  the  base 
avionics  maintenance  shop  for  subsequent  maintenance  action 
or  to  a  Depot  or  Special  Repair  Activity  (SRA)  for  repair. 

%  Shop  Repairs.  The  percentage  of  all  D056  reported 
unscheduled  maintenance  actions  on  which  the  equipment  item 
is  reported  as  repaired  at  the  base  avionics  maintenance  shop. 

%  No  Defect.  The  percentage  of  all  D056  reported  unscheduled 
maintenance  actions  on  which  the  equipment  item  is  reported 
to  have  "No  Defect"  at  the  weapon  system  (On-Equipment) 
level. 

%  Removed  to  Facilitate  Other  Maintenance  (RTFOMh  The 
percentage  of  all  D056  reported  unscheduled  maintenance 
actions  on  which  the  equipment  item  is  reported  as  "Removed 
to  facilitate  Other  Maintenance"  or  removed  for  reasons 
other  than  failure  or  discrepancy  on  the  part  of  the  equipment 
item  (How  Mai  codes  800-805  inclusive). 
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APPENDIX  A 

DATA  SOURCES  AND  FACILITIES  VISITED 


I 


AVIONICS  EQUIPMENT  MANUFACTURERS 


CONRAC  Electronics,  Inc. 
Duarte,  CA 

Collins  Radio,  Inc. 

Cedar  Rapids,  MI 

Hughes  Aircraft  Company 
Culver  City,  CA 


IBM  Federal  Systems  Division 
Owego,  NY 

Magnavox  Corp. 

Ft.  Wayne,  IN 

Norden  Electronics,  Inc. 
Melville,  L.  I.  ,  NY 


WEAPON  SYSTEM  PRIM E  CON  TRAC  TORS 

The  Boeing  Company 
Wichita,  KA 


General  Dynamics  FW  Division 
Ft.  Worth,  TX 

LTV-Fairchild 
Dallas,  TX 

USAF  FACILITIES 

Aeronautical  Systems  Division 
AFSC 

Wright-Patterson  AFB,  OH 

AF  Flight  Dynamic  Labs.  ,  AFSC 
Wright-Patterson,  AFB,  OH 

Headquarters,  AFLC 
Wright-Patterson,  AFB,  OH 

Headquarters,  A  TC 
Randolph  AFB,  TX 

Headquarters,  MAC 
Scott  AFB,  IL 

Headquarters,  SAC 
Offutt  AFB,  NB 

Headquarters,  TAC 
Langley  AFE,  VA 

Oklahoma  City  ALC 
Tinker  AFB,  OK 


Lockheed-Georgia  Corp. 
Marietta,  GA 

McDonnell-Douglas  Aircraft 
St.  Louis,  MO 

Northrop  Aircraft 
Hawthorne,  CA 


Headquarters,  AFSC 
Andrews  AFB,  MD 

Headquarters,  USAF 
Washington,  DC 

Headquarters,  ADC 
Colorado  Springs,  CO 

Rome  Air  Development  Center 
Griffiss  AFB,  NY 

Sacramento  ALC 
McClellan  AFB,  CA 

San  Antonio,  ALC 
Kelly  AFB,  TX 

Warner-Robins  ALC 
Robins  AFB,  GA 


USAF  AIR  BASES 


Davis  Monthan  AFB,  AZ 
George  AFB,  CA 
Griffies  AFB,  NY 
Holloman  AFB,  NM 
Kelly  AFB,  TX 
Lake  AFB,  AZ 
March  AFB,  CA 
Mather  AFB,  CA 
Nellis  AFB,  NV 
Norton  AFB,  CA 
Pease  AFB,  NH 
Plattsburg  AFB,  NY 
Randolph  AFB,  TX 
Robins  AFB,  GA 
Tinker  AFB,  OK 
Travis  AFB,  CA 
Williams  AFB,  AZ 


APPENDIX  B 


FIELD  DATA  ANALYSIS  SUMMARIES 

Sample  analysis  results  for  ARN-118  TACAN  Set  on  T-38  Aircraft 
for  12  months  period  ending  31  December  1978. 
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APPENDIX  C 


ENVIRONMENTAL  STRESS  SEVERITY  FACTOR  CONSIDERATIONS 


This  appendix  describes  a  theory  developed  at  Hughes  Aircraft 
Company  pertaining  to  the  precipitation  of  failures  from  flaws  in  a  piece  of 
equipment  by  means  of  application  of  environmental  screening  stresses.  By 
doing  so  the  reliability  of  a  piece  of  equipment  can  be  increased.  This 
theory  is  also  applicable  to  equipments  under  normal  usage  stress.  There¬ 
fore,  the  severity  rate  of  environmental  screening,  as  it  is  called  herein, 
is  a  measure  of  the  severity  of  any  environment  —  natural  or  artifical  —  on 
the  equipment.  By  analyzing  the  failure  data  with  respect  to  time,  the 
severity  factor  for  a  particular  use  environment  can  be  determined.  The 
following  are  excerpts  from  Reference  45-  expounding  this  theory. 

UNDERLYING  POSTULATES 

Hughes  reliability  growth  theory  i6  based  upon  the  following  postulates. 

1.  Flaws  are  latent  failures  which  are  due  to  imperfections  in 
design,  workmanship  or  material.  Flawed  items  form  a 
separate  population  possessing  a  significantly  shorter  stress 
life  than  the  typical  long  life  of  high  reliability  items. 

2.  A  failure  is  the  precipitation  of  a  flaw  into  an  observable 
anomaly  of  performance.  All  observable  anomalies  are  not 
observed,  hence  unobserved  failures  must  be  taken  into  account. 

3.  A  screen  is  the  application  of  stress  to  precipitate  failures  at 
a  convenient  time. 

4.  The  rate  at  which  flaws  are  forced  into  failures  by  a  screen  is 
proportional  to  the  number  of  flaws  in  the  equipment  being 
screened. 

5.  The  number  of  flaws  in  an  equipment  will  decrease  as  more 
equipments  are  manufactured  and  tested  since  normal  quality 
control  and  reliability  procedures  will  correct  flaws  resulting 
from  assignable  causes. 


C-  1 


6.  A  test  analyze  and  fix  (TAAF)  procedure  accelerates  the  design 
reliability  growth  processes  and,  as  design  improvements  are 
incorporated,  has  the  apparent  effect  of  replacing  the  equipment 
in  TAAF  with  one  of  a  higher  serial  number, 

7.  After  the  early  production  period,  when  the  majority  of  the  gross 
design  flaws  have  been  eliminated,  the  number  of  flaws  in  the 
equipment  can  be  reduced  by  forcing  them  into  observed  failures 
and  making  reasonable  repairs. 

8.  Flaws  eliminated  by  the  learning  process  are  theoretically  non¬ 
recurrent  while  flaws  removed  by  the  screening  process  may 
exist  in  subsequent  equipments. 

THE  THREE  DIMENSIONAL  CONCEPT 

Product  improvement  occurs  as  a  result  of  two  simultaneous  pro¬ 
cesses.  One  process  is  referred  to  as  production  learning  and  is  measured 
by  production  sequence  or  time  usually  coincident  with  product  serial  number 
The  second  process  is  due  to  screening  which  is  measured  by  screen  time. 

Figure  C-l  shows  the  relationship  of  the  two  processes.  The  instanta 
neous  unreliability  of  a  product,  X  ,  represented  on  the  vertical  axis,  is  a 
function  of  two  independent  variables,  each  representing  a  different  interpre¬ 
tation  of  "time".  The  effect  of  learning  is  represented  in  the  M,  X  plane  and 
the  effect  of  screening  is  represented  in  the  t,  X  plane.  Thus,  X  (M,t)  depicts 
the  instantaneous  failure  rate  of  the  Mth  production  equipment  at  screen 
time  t. 

The  fundamental  mathematical  model  that  combines  the  learning 
and  screening  concepts  to  produce  the  three  dimensional  figure  can  be 
expressed  as 


where  D  represents  failure  detection  efficiency,  k  is  the  screen  severity 
rate,  U(l,  t)  denotes  the  number  of  flaws  contained  in  equipment  serial 
number  one  at  time  t,  M  represents  and  equipment  serial  number  and 
denotes  the  constant  learning  factor.  Each  of  these  factors  must  be  carefully 
addressed  in  order  to  plan  and  control  a  reliability  growth  program.  The 
following  sections  further  describe  and  justify  the  factors. 


Figure  C-t.  Three  dimaniional  concept 
of  reliability  growth. 

THE  LEARNING  PROCESS 

For  many  years  estimates  of  the  time  to  manufacture  of  product 
were  calculated  using  the  classical  learning  curve  model  [4]: 

H  =  b  x  -k  (1) 

where  Hx  is  the  cumulative  average  time  to  produce  the  firxt  x  equipments, 
b  denotes  the  time  to  produce  the  first  equipment  and  k  represents  the  learn 
ing  curve  slope.  Furthermore,  the  time  necessary  to  produce  the  xth  equip 
ment  is  defined  by 

hx  =  b  x"k  (l-k),x  >10  (2) 

On  log,  log  graph  paper  expression  (1)  and  expression  (2)  are  represented 
by  straight  lines  as  shown  in  Figure  C-2. 


Figure  C-2.  Typical  laamirtg  curve  u»d  in 
production  time  estimation. 

Improvements  in  workmanship  and  processes  and  the  implementation 
of  design  changes  to  correct  problems  are  among  the  reasons  for  the  reduc¬ 
tion  in  time  to  produce  successive  equipments.  Since  these  activities  also 
remove  flaws  in  the  equipment,  expression  (1)  can  be  rewritten  in  terms  of 
failure  rate  to  conform  to  the  time  designations  previously  discussed.  Thus, 

MM,  0)=  (1,  0)  (3) 

where  MM,  0)  is  the  cumulative  average  failure  rate  for  equipments  1 
through  M  at  screen  time  0;\(l,  0)  denotes  the  failure  rate  for  the  first 
equipment  and  o  is  the  learning  curve  slope. 

Furthermore,  the  failure  rate  of  an  individual  equipment  at  any 
screen  time,  t,  can  be  written  as 

MM,  t)  =  Ml,  t)  M_°(l  -a),  M  >  10 


(4) 


The  latter  relationship  was  verified  for  three  Hughes  production  pro¬ 
grams,  each  of  which  produced  approximately  250  systems.  Thus,  we  see 
that  the  classical  learning  process  relationship  expressed  in  terms  of  time 
to  produce  the  xth  equipment  given  by  (2)  properly  holds  when  expressed  in 
terms  of  failure  rate  of  the  Mth  equipment  at  time  t  as  given  by  (4). 


THE  SCREENING  PROCESS 

Three  different  screening  models  are  employed  by  Hughes,  namely, 
LOOK  AHEAD,  CREDIT  and  AFAR.  The  three  models  evolved  from  the 
same  basic  approach  and  differ  only  in  the  level  of  detail  that  may  be  attained 
and  the  method  of  calculating  the  strength  of  a  screen. 

The  models  are  based  on  the  postulate  which  states  that  the  rate  at 
which  flaws  are  forced  into  failures  by  a  screen  is  proportional  to  the  num¬ 
ber  of  flaws  in  the  equipment  being  screened,  i.  e.  , 


where 


U  a  number  of  flaws  in  an  equipment 
AU  =  the  incremental  change  in  U,  and 

At  =  the  incremental  time  the  equipment  is  exposed  to  an  environment 

Thus, 


and  by  integration 


dU 

ar  = 


-kU 


[log  U)*  =  [-kt]* 


U  ,  =  U  e 
t  o 


-kt 


(5) 


By  definition,  k  is  the  severity  rate  of  the  environmental  screen  applied 
(this  factor  is  discussed  further  in  a  subsequent  section).  Ut  represents  the 


number  of  flaws  in  the  e^uiprrmnt  at  the  end  of  screen  time  t  and  UQ 
represents  the  number  of  flaws  in  the  equipment  prior  to  the  application  of 
the  screen. 

The  fundamental  quantitative  result  of  a  screen  or  a  test  is  the 
number  of  failures  observer..  In  this  case,  the  expected  number  of  failures, 
f,  that  will  be  observed  upon  applying  a  particular  screen  is  calculated  by 

f  =  D  Uq  (l-e'kt)  (6) 

where  D  represents  the  detection  efficiency.  This  result  can  be  justified 
by  recognizing  that  the  number  ox  obse rvable  failures  for  a  particular 
screen  is  U0  -  U*  and  the  expected  number  of  observed  failures  depends  on 
.he  ability  to  detect  the  ob.  crvable  failures,  thus 

f  =  D  (U0-Ut). 

Substituting  expression  (5)  for  L't  in  the  above  yields  expression  (o). 

From  expression  (o),  \  (t),  the  instantaneous  failure  rate  at  any  time 
is  defined  as  the  derivative  of  -'bservec  failures  with  respect  to  time,  i.e., 

ai =  Mti  =  d  k  uQ.**kt  (?) 

and  from  (5) 

Mt>  -  D  k  Ut.  (S) 

Furthermore,  for  the  M.th  equipment  at  screen  time  t, 

MM,  t)  =  D  k  U  (M,  t).  (9) 

where  U  iM,  tl  represen's  the  number  of  liaws  in  the  Mth  equipment  at  the 
end  o;  rime  t. 

Figure  C-3  generally  illustrates  the  negative  exponential  effect  of 
typ’cal  environmental  screens  on  V  tor  a  particular  equipment  serial  number 
in  the  t,  \  plane. 


! 


\ 

|  Figure  C-3.  Environmental  screening  effect  on  system  reliability. 


It  follows  from  expression  (9)  that  the  failure  rate  of  the  first 
equipment  at  time  t  can  be  determined  by 

X(l,  t)  =  D  k.  U  (1,  t) 


and  appropriate  substitution  of  the  above  into  the  learning  process  relation¬ 
ship  given  by  expression  (4)  yeilds  the  fundamental  AFAR  growth  model 
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